DOCUMENT  RESUME 


ED  267  753 


IR  012  121 


AUTHOR 
TITLE 


INSTITUTION 

PUB  DATE 
NOTE 

PUB  TYPF 


EDRS  PRICE 
DESCRIPTORS 


IDENTIFIERS 


Simonson,  Michael  R.,  Ed.,*  And  Otl^rs 

Proceedings  of  Selected  Research  Paper  Presentations 

at  the  1986  Convention  of  the  Association  for 

Educational  Communications  an^  TfiChnology  and 

Sponsored  by  the  Research  and  Theory  Division  (Las 

Vegas,  NV,  January  16-21,  1986). 

Association  for  Educational  Conununi  cat  ions  and 

Technology,  Washington,  b.C. 

Jan  86 

848p.;  For  individual  papers,  see  IR  012  122-168.  For 
an  earlier  proceedings,  see  ED  256  301. 
Collected  Works  -  Conference  Proceedings  (021) 
Viewpoints  (120)  —  Reports  -  Researca/Technical 
(143) 

MF05/PC34  Plus  Postage. 

*Cognitive  Processes;  Cognitive  Style;  *Coniputer 
Assisted  Instruction;  Educational  Media;  *Educational 
Technology;  Educational  Television;  *Instructional 
Design;  Instructional  Develoj^ent;  Intermode 
differences;  Learning  Strategies;  *Media  Research; 
*Microcomputers;  Programing  Language*;;  Research 
Methodology;  Teaching  Methods;  Visual  Learning 
AECT  Research  and  Theory  Division  Meeting; 
Interactive  Video;  LOGO  Programing  Language;  Media 
Characteristics 


ABSTRACT 

Current  issues  in  educational  communications  and 
technology  are  addressed  in  this  collection  of  47  papers,  in  which 
research  reports  dominate.  Topics  discussed  include  factors  related 
to  the  learner,  e.g.,  problem-solving  skills,  motivation,  comparison 
of  instructional  design  strategies,  effects  of  organizational  c  ^s 
and  text  layouts,  and  learning  strategies.  Several  papers  exj^mine 
innovative  educational  media  such  as  interactive  video,  electronic 
mail,  teletraining,  computer-assisted  instruction,  computer-generated 
te.n,  simulations,  and  microcomputers.  Additional  papers  discuss  the 
use  of  cable  television  in  higher  education,  noncommercia]  FM  radio 
stations,  instructional  television  services,  use  of  bulletin  boards 
and  electronic  mail  in  distance  education,  evaluation  of  media 
support  services,  user  attitudes  towtrl  computers,  and  effects  of 
Logo  instruction.  References  and  data  tables  are  rncluded  with  many 
papers.  Cumulative  indexes  of  authors  and  descriptors  covering  the 
first  eight  volumes  of  conference  proceedings  <1979-1986)  for  the 
Research  and  Theory  Division  of  the  Association  for  Educational 
Communications  and  Technology  are  included.  (JB) 


***  I,**  1,1, 1,1,1,*  I,**  1,1,1,1, 1,1,1,1,1, 1,1, 1,1, 1,1, 1,1, 1,1, 1,1, 1,1,1,1, 1,1, 1,1,1,1,1, 1,1,1,1, 

*  Reproductions  supplied  by  EDRS  are  the  best  that  can  be  made  * 

*  from  the  original  document.  * 
*****************  ^ii********************  I,*********  1,1,1,1,1,1, 1,1,1,1,1,1, 1,1,1,1, 1,1, 1,1,1,1, 


ERIC 


in 

sO 

CM 

o 


U.S.  DEPAmMENT  OF  EDUCATION 

OERT 

EDUCATIONAL  RESOURCES  INFORMATION 
CENTER  (ERIC) 
Th<s  document  has  b««n  reproduced  as 
'     received  from  the  person  or  organization 

Originating  it 
>  '  Minor  changes  have  been  made  to  improve 
reproduce  on  quality 


PROCEEDINGS  OF  SELECTED  RESEARCH 
PAPER  PRESENTATIONS 

at  the  1986  Convention  of  the 
Association  for  Educational  Communications  and  Technology 
and  sponsored  by  the 
Research  and  Theory  Division 
in 

Las  Vegas,  Nev^*da 


•  Points  of  view  or  opinions  stated  in  this  docu 
ment  do  not  necessarily  represent  ofricial 
positton  or  policy 


Edited  by: 

Michael  R.  Simonson 
Professor  of  Secondary  Education 

Elinor  Coble 
Teaching  Assistant 

and 


James  Hayward 
Teaching  Assistant 


Iowa  State  University 
College  of  Education 
Instructional  Resources  Center 
Quadrangle  North 
Ames,  Iowa  50011 
(515)  294-6840 


•PERMISSION  TO  REPRODUCE  THIS 
MATERIAL  HAS  BEEN  GRANTED  BY 

Michael  Simonson 


TO  THe  EDUCATIONAL  RESOURCES 
INFORMATION  CENTER  (ERIC)" 


1986 

Research  &  Theory  Division  Officers 


Louis  Berry  (President,  1985-1986) 
Department  of  Educational  Communications 
103  LIS  Bldg. 
University  of  Pittsburgh 
Pittsburgh,  PA  ^5?60 
(412)  624-6910 

Barbara  Grabowski  (  .st-President) 
University  of  Maryland 
University  College 
University  Boulevard  at  Adelphi 
College  Park,  MD  20742 
Work    (301)  454-6709 

Tillman  Ragan  (President-Elect) 
College  of  Education 
University  of  Oklahoma 
Norman,  OK  73069 
(405)  325-1521 


Board  of  Directors 


Marina  Mclsaac  (1983-86) 
Dept.  of  Educational  Technology 
Arizona  State  University 
Box  FLS 

Tempe,  AZ  85281 
(602)  965-7191 

Phil  Brody  (1983-86) 
Instructional  Media  Center 
Bailey  Hall  Annex 
University  of  Kansas 
Lawrence,  KS  66045 
(206)  543-1877 

David  Jonassen  (1985-88) 
Educational  Technology 
University  of  North  Carolina-Greensboro 
Greensboro,  NC  27401 
(919)  379-5100 

Melvin  Bowie  (1984-87) 
College  of  Education 
University  of  Arkansas 
Fayetteville,  AR  72701 


Michael  Striebel  (1983-86) 
Rd  #1 
Box  257 

Port  Matilda,  PA  16870 
(814)  327-5022 


Stephen  Kerr  (1985-88) 
Educational  Communication 

&  Technology 
University  of  Washington 
Seattle,  WA  98105 
(913)  864-3057 

Francis  Clark 

College  of  Education  and 

Graduate  College 
Texas  A  &  M  University 
College  Station,  TX  77840 

Rhonda  Robinson  (1984-87) 
Dept.  of  L.E.P.S. 
Northern  niinois  University 
DeKalb,  IL  60115 


Naomi  Story  (1985-88) 
Instruction  of  Design 
Maricopa  Community  Colleges 
Phoenix,  AZ  85004 
(602)  244-8355 


PREFACE 


For  the  eighth  year,  the  Research  and  Theory  Division  of  the  Association 
for  Educational  Communications  and  Technology  (AECT)  is  publishing  these 
Proceedings,    Papers  published  in  this  volume  were  presented  at  the  national 
AECT  Convention  in  Las  Vegas,  NV.    A  limited  quantity  of  this  volume  were 
printed  and  sold.    It  is  also  available  on  microfi  .le  through  the  Educational 
Resources  Information  Clearinghouse  (ERIC)  system, 

REFERFEIN6  PROCESS:    All  Research  and  Theory  Division  research  paperr  selected 
for  presentation  at  the  AECT  Convention  and  included  in  this  Proceedings  were 
subjected  to  a  rigorous  blind  reviewing  process.    Proposals  were  submitted 
to  Dr,  Melvin  Bowie  of  the  University  of  Arkansas,  who  coordinated  the  review 
process.    All  references  to  author  were  removed  from  proposals  before  they 
were  submitted  to  referees  for  review.    Approximately  sixty  percent  of  the 
manuscripts  subn.itted  for  consideration  were  selected  for  presentation  at  the 
Conventior.  and  for  publication  in  these  Proceedings,    The  papers  contained 
in  this  document  represent  sone  of  the  most  current  thinking  in  educational 
communications  and  technology. 

This  volume  contains  two  cumulative  indexes  covering  the  first  eight 
volumes,  1979-1986.    The  first  is  an  author  index.    The  second  is  a  descriptor 
index.    The  two  indexes  will  be  updated  in  future  editions  of  this  Proceedings. 

M.  R.  Simonson 
Editor 


i 


-1986  REVIEW  PANEL- 


Gary  Anglin 

University  of  Kentucky 
Lexington,  Kentucky 


Ann  Becker 

University  of  Wisconsin 
Madison,  Wisconsin 


Louis  Berry 

University  of  Pittsburgh 
Pittsburgh,  Pennsylvania 


Melvin  Bowie,  Chairman 
University  of  Arkansas 
Fayettevi lie,  Arkansas 


Philip  Brody 

Saint  Louis  Public  Schools 
Saint  Louis,  Missouri 


James  Canelos 

Pennsylvania  State  Engineering 
University  Park,  Pennsylvania 


David  Carl 

University  of  Arkansas 
Fayettevi lie,   Arkansa  s 


Francis  Dwyer 

Pennsylvania  State  University 
State  College,  Pennsylvania 

Tillman  Ragan 
University  of  Oklahoma 
Norman,  Oklahoma 


Michael  Simonson 
Iowa  State  University 
Ames,  Iowa 


Susan  R.  Storm 
1055  Hoffm^in 
Petoskey,  Michigan 

Naomi  0.  Story 

Maricopa  Community  Colleges 

Phoenix,  Arizona 


Vernon  Gerlach 

Arizona  State  University 

Tempe,  Arizona 


Barbara  Grabowski 
University  of  Maryland 
College  Park,  Marylcnd 


May  Lein  Ho 

University  of  Arkansas 
Fayettevi lie,  Arkansas 


John  H.  Joseph 

Pennsylvania  State  Capitol  Campus 
Middletown,  Pennsylvania 


Barbara  L.  Martin 
Kent  State  University 
Kent,  Ohio 


Mary  Lou  Mosley 

Maricopa  Community  Colleges 

Phoenix,  Arizona 


Tom  Nielsen 

346  Shades  Crest  Road 

Birmingham,  Alabama 


Josephine  Raburn 
Cameron  University 
Lawton,  Oklahoma 

Michael  J.  Streibel 
University  of  Wisconsin 
Madison,  Wisconsin 


James  G.  Sucy 
343  State  Street 
Rochester,    New  York 


Paul  W.  Wei  liver 
Pennsylvania  State  University 
University  Park,  Pennsylvania 


Richard  Wise 
8  Cobbleston  Way 
Windsor,  Connecticut 


ERIC 


5 


ERIC  DOCUMENT  NUMBERS 
for 

PREVIOUS  EDITIONS 
of  the 
PROCEEDINGS 


.Year  Location  ED  Number 

1979  New  Orleans  171329 

1980  Denver  19406i 

1981  Philadelphia  207487 

1982  Dallas  223191  to 

223236 

1983  New  Orleans  231337 

1984  Dallas  243411 

1985  Annaheim  256301 


6 


TABLE  OF  CONTENTS 


Effectiveness  of  Interactive  Video  in  Teaching  Basic 
Photography  Skills 

By  Arnie  Abrams    1 

Lffect  of  Pictures  on  Recall  of  Written  Prose:    How  Durable 
are  Picture  Effects? 

By  Gary  J.  Anglin   _  15 

The  Display  of  Color  Graphics  on  Monochrome  Monitors: 

A  Concern  for  Designers  and  an  Opportunity  for  Researchers 

By  Patti  R.  Baker,  John  C.  Bel  land  and  Marjorie  A.  Cambre    36 

Instructional  Film  Research  and  the  Learner 

By  Melvin  McKinney  Bowie    49 

External  Pacing  as  an  Instructional  Strategy  for  the  Design 
of  Micro-Computer  Based  Instructional  Programs  to  Improve 
Performance  on  Higher  Level  Instructional  Objectives 
By  J^imes  Canelos,  Patti  Baker,  William  Taylor,  John  Belland 

and  Francis  Dwyer    65 

An  Assessment  of  Nursing  Attitudes  Toward  Computers  in 
Health  Care 

By  David  L.  Carl,  Rachel  R.  Carl  and  Sherry  Greathouse    85 

Research  on  Tt*letraining:    Student  Acceptance,  Learning 

Effectiveness  and  Cost  Be..efits  in  the  Corporate  Environment 

By  Alan  G.  Chute    106 

A  Comparison  of  the  Effects  of  Logo  Use  and  Teacher-Directed 
Problem-Solving  Instruction  on  the  Problem-Solving  Skills, 
Achievement,  and  Attitudes  of  Low,  Average,  and  High 
Achieving  Junior  High  School  Learners 

By  David  W.  Dalton    119 

Thp  Effects  of  Video-Only,  CAI  Only,  and  Interactive  Video 
Instructional  Systems  on  Learner  Performance  and  Attitude: 
An  Exploratory  Study 

By  David  W.  Dalton  and  Michael  J.  Hannafin    153 

Word  Processing  and  the  Writing  Process:    Enhancement  or 
Distraction 

By  Livid  W.  Dalton  and  James  F.  Watson    166 

A  Comprehensive  Study  of  the  Operational  Problems  of  Higher 
Education  Affiliated  Cable  Television  Stations 

By  Kurt  P.  Dudt  and  Richard  J.  Lamberski    185 

A  Methodology  in  Studying  Higher  Education  Affiliated  Cable 
Television  Stations 

By  Kurt  P.  Dudt  and  Richard  J.  Lamberski    195 

Selecting  Media  For  Instruction 

By  L.J.  Evans   210 


ERLC 


Feasibility  Study  of  Bulletin  Board  and  Electronic  Mail 
Technologies  for  the  Improvement  of  Student/Instructor 
Communications  Used  in  ''Distant"  Education  Course  Offerings 
By  C.  Hugh  Gardner  and  Murray  H.  Tillman    220 

The  Accui-acy  of  Cognitive  Monitoring  During  Computer-Based 
Instruction 

By  Casey  Garhart  and  Michael  Hannafin   ,   230 

A  Time  Management  Study 

By  Helen  M.  Gothberg,  Donald  E.  Riggs  and  Lawrence  M.  Aleamoni    252 

Relationships  Among  Text  Format  Variables  in  Computer-Generated 
Text 

By  R.  Scott  Grabinger    271 

Extending  Graduate  Level  Education:    A  Management  Model 

By  Robert  L.  Hales  and  Stephen  B.  Felt  ,   302 

A  Comparison  of  Task  Analysis,  Advance  Organizer,  and  Concept 
Elaboration  Methods  in  Teaching  Concepts  and  Principles 
By  Walter  V.  Hanclosky    313 

The  Effects  of  Presentation  Latency  and  Embedded  Orienting 
Strategies  on  Learning  from  Computer-Based  Instruction 
By  M.  Hannafin,  T.  L.  Phillips,  L.  P.  Rieber  and  C.  Garhart    336 

The  Effect  of  Fluid  Ability,  Visual  Ability,  and  Visual  " 
Placement  Within  the  Screen  on  a  Simple  Concept  Task 

By  Russ  A.  Hart    358 

Collectiny  Mapping  in  School  Library  Media  Centers 

By  May  Lein  Ho  and  David  Loertscher    390 

Principals'  and  Teachers'  Attitudes  Toward  Kansas  School 
Media  Libraries 

By  John  A.  Hortin    410 

Longitudinal  Curriculum  Changes  in  Instructional  Design 
and  Educational  Psychology  Doctoral  Programs 

By  J.  Daniel  House,  and  Barry  Bratton  and  Craig  L.  Gjerde    421 

Effects  of  Microcomputer  Display  on  a  Perceptual/Cognitive  Task 

By  David  H.  Jonassen    451 

State  Anxiety  an  Exposure  to  Microcomputers:  Assessing 
Computerphobia 

By  David  H.  Jonassen   461 

List  Verses  Flow  Chart  Representations  of  Algorithms  for  a 
Search  Task 

By  David  H.  Jonassen  _,id  Marilyn  Pearson  469 

The  1903-84  Maryland  JTV  Study  Summary  Report 

By  Paul  E.  Jones    478 


6^ 


Descriptive  Study  of  Noncommercial  FM  Radio  Stations 
Affiliated  with  Colleges  and  Univers^. ties 

By  Mary  Beth  Leidrran  and  Richard  J.  Lamberski    490 

A  Methodology  in  Studying   Noncommercial  FM  Radio 
Stations      A  Case  Study 

By  Mary  Beth  Leidman  and  ki chard  J.  La.nberski    505 

Effects      Selected  Filmic  Coding  Elements  of  TV  on  the 
Development  of  the  Euclidean  Concepts  or  Horizontal ity 
and  Ve^ticality  in  Adolescents 

By  Beth  Eloise  Lynch    E^l 

Memphis  State  Regression  Computer-Managed  Irstruction  Model 

By  Gary  R.  Morrison  and  Steven  M.  Ross   <  530 

Instructional  Strategies  in  CAI:    Instructional  Design 
Theory  Neeas 

By  Tillman  J.  Ragan    542 

Evaluating  Media  Suppo»^t  Services:    An  Ethnographic  Approach 

By  James  P.  Randall    552 

The  Effect  of  Logo  on  Young  Children 

By  Lloyd  P.  Rieber   562 

Interactive  Cable  Television:    An  Evaluation  Study 

By  Rhonda  S.  Robinson  and  Peter  C.  West    598 

What  Your  Professor  Never  Told  You  About  the  Mundare 
Practice  of  Instructional  Design 

By  Allison  Rossett    612 

Microcomputers  and  Continuing  Motivation 

By  Sherrie  L.  Seymour,  Howard  J.  Sullivan,  Naomi  0.  Story 

and  Mary  Lou  Mosely    620 

The  Effects  of  Organizational  Cues  on  Learners' 
Processing  of  Instructional  Prose 

By  Patricia  L.  Smith    635 

Instructional  Simulation:    Research,  Theory,  and  a  Case  Study 

By  Peter  Smith    656 

"Newscast  From  the  Past":    A  Dynamic  New  TV  Series  with  a 
Global  Perspective  on  World  History 

By  Drew  Tiene    721 

Using  Television  to  Develop  "The  High  School  of  the  Future" 

By  Drew  Tiene    745 

Old  Wine  in  New  Bottles:    Subliminal  Messages  in 
Instructional  Media 

By  Margaret  Treimer  and  Michael  R.  Simonson    763 

Educational  Computing  inservice  Design:    Implications  from 
Teachers'  Concerns  Research 

By  John  F.  Wedman    782 


ERLC 


9 


Graduate  Student  Contributions  to  AECT  and  to  the 
Future  of  Educational  Technology 

By  Paul  W.  Welliver    797 

Emerging  Trends  in  Educational  Technology  Research 

By  William  Winn   801 

Learner  Environment  Fit:    University  Students  in  a 
Computer  Room 

By  Andrew  R.  J.  Yeaman    833 

Cumulative  1985-86  Author  Index    848 

Cumulative  1979-84  Author  Inuex    854 

Cumulative  1985-86  Subject  Index    866 

Cumulative  1979-84  Subject  Index    872 


JO 


EFFECTIVENESS  OF  INTERACTIVE  VIDEO 
IN  TEACHING  BASIC  PHOTOGPAPHY  SKILLS 


DR.  ARNIE  ABRAMS 
SOUTriERiN  OkEGO;4  STATE  COLLEGE 

PRESENTED  AT 
THE  ANNUAL  CONF'iRENCE  OF  AECT 
LAS  VEGAS,  NV.     JANUARY  21,  1986 

Int roduct  ion 

The  introduction  of  a  new  instructional  technology  has 
historically  been  followed  by  immoderaue  claims  about  the  impact  and 
effectiveness  of  that  technology.    This  has  occurred  wich  motion 
pictures,  television  and  computer-cassis  ted  instruction.     The  latest 
extravagant  claims  are  for  interactive  video;  a  mediun.  that  combines 
the  processing  power  of  a  microcomputer  with  the  visual  and  auditory 
strength  of  videotape  or  videodisc  (Grabowski,  1984;  Leveridge,  1979; 
Waldrop,  1983).     As  with  other  media,  the  early  years  of  implementation 
are  filled  with  extreme  claims,  inappropriate  applications,  and 
enormous  promise. 

Bold  predictions  about  interactive  video  have  been  made,  but  few 
studies  have  actually  been  conducted  to  validate  or  refute  these 
claims.     A  preponderance  of  the  literature  is  based  on  anecdotal 
accounts  and  is  often  written  from  a  stance  of  advocacy  (Bosco,  1984). 
This  study  addressed  the  need  for  systematic  research  to  measure  the 
effectiveness  of  interactive  video  as  an  instructional  tool. 

Purpose  of  the  Study 

The  major  purpose  of  this  study  was  to  assess  the  effectiveness  oL 
interactive  video  in  the  teaching/ learning  process.     More  specifically, 
a  comparison  was  made  of  the  relative  effectiveness  of  interactive 
video  and  linear  video  as  delivery  modes  in  the  acquisition  of  basic 
photography  skills  in  an  independent  learning  environment  at  a  college 
level. 

A  second  impetus  for  the  study  stemmed  from  the  wide  diversity  of 
photography  skills  and  experience  typically  possessed  by  the  students 
in  the  population.     For  many  students  who  have  no  prior  photographic 
experience,  traditional  group  instruction  proceeds  too  rapidl>;  for 
others  with  considerable  experience,  the  instruction  will  often  be 
repetitive-     This  diversity  suggested  the  need  for  an  alternative  mode 
of  delivery.    The  investigator  postulated  that  a  self-instructional, 
self-paced  approach  would  be  beneficial  for  both  novices  and 
experienced  photographers. 

Research  Objectives 

The  primary  objectives  of  this  study  were  : 

1.     To  determine  if  there  is  a  significant  difference  (p.<.05)  in 
achievement  between  students  who  receive  instruction  using  an 
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interactive  video  mode  and  those  using  a  linear  video  mode. 

2.  To  determine  if  there  are  significant  differences  (p.<.05)  in 
attitudes  about  the  instruction  between  students  using  an 
interactive  video  mode  and  those  using  a  linear  video  mode. 

3.  To  analyze  the  factors  which  contribute  to  the  difference  in 
achievement  between  the  groups. 

4.  To  analyze  factors  contributi-^  to  the  differences  in  attitudes 
between  the  groups. 

Procedures 


In  this  study,  students  enrolled  in  a  teacher  education  program 
received  instruction  in  basic  photography  skills  in  one  of  two  methods. 
The  control  group  (N=64)  received  instruction  In  an  independent 
learning  environment  via  a  linear  videotape  (LV).     The  experimental 
group  (N=64)  also  received  instruction  in  an  independent  learning 
environment  but  via  interactive  video  (IV).     Interactive  video  refers 
to  computer-controlled  video  which  allows  branching  of  the  program  for 
remediatior  or  enrichment  (Floyd, 1980;  Levenson,  1983;  Troutner,  1983). 
The  tapes  were  produced  by  the  investigator  and  the  content  of  both 
tapes  was  nearly  identical. 

Using  a  random  number  table  (Borg  and  Gall,  1983),  students  were 
assigned  to  experimental  and  control  groups.     Participants  then 
completed  a  25-item  written  multiple-choice  test  (pre-test)  covering 
key  concepts  incorporated  in  the  videotapes.     Subjects  waited  five  to 
seven  weeks  before  watching  the  appropriate  videotape.     Students  were 
given  an  alternative  fona  of  the  same  test  (post-test)  immediately 
following  the,  treatment.     Analysis  of  covariance  was  used  to  compare 
achievement  of  the  control  group  with  that  of  the  experimental  group, 
ihe  pretest  was  used  as  a  covariatc  in  order  to  adjust  for  initial 
differences  between  groups,  reduce  sampling  error,  and  to  give  a  more 
precise  estimate  of  post  instructional  performance  (posttest). 

Participants  also  completed  an  attitude  survey.    This  form  offered 
insights  into  students*  perceptions  concerning  the  instruction.  The 
written  reaction  form  was  measured  on  a  five-point  Likert  scale,  and 
related  to  such  items  as  rate  of  instruction,  frustration  level, 
technical  problems,  and  motivation.     Significance  of  between  group 
differences  on  individual  items  was  tested  using  the  Mann—Whitney  U 
test,  and  ordinal  consensus  was  measured  using  a  Leik  scale. 

Results 
Achievement 

Results  indicated  that  the  IV  group  recorded  significantly  and 
consistently  larger  achievement  gains  than  did  the  LV  group.     There  was 
a  difference  in  means  between  pretest  and  posttest  scores  of  29.70 
(from  49.80  to  79.50)  points  for  th^  linear  group  as  compared  to  35.81 
(48.94  to  84.75)  for  the  IV  group  (Table  1).     The  average  difference  of 
6.11  points  in  favor  of  the  IV  group,   is  significant  at  the   .001  level 
(F=10.48).     The  ANCOVA  table  (Table  2)  shows  a  highly  significant  F  (p.< 
.001)    which  indicates  a  1  ow  probability  that  fhese  differences  were 
due  Lo  chance. 
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Table  1 


Comparison  of  Pretest,  Posttest,  and  rtdjusted  Posttest  Means 


Group 

Prete-  r. 
Mean 

Posttest 
Mean 

Adjusted 
Post  Mean 

N  Gain 

Gain 
Diff. 

IV 
LV 

48.94 
49.80 

84.75 
79.50 

84.95         64       35. P  . 

6.11 

79.30         64  29.70 

Table 

I 

Analysis  of  Covariance 

-  Treatment 

Effect 

Source  of 
varia t  ion 

Adjusted 
Df 

Adjusted 
SS 

Adjusted 
MS 

Computed 
F 

Tabular 
F 

Between 
Group  s 

1 

1037.33 

1017.33 

10.48 

3.90 

Within 
(^.rror) 

125 

12131.62 

97.05 

Total 

126 

13148.95 

Significance  0.0019 


Summary  of  Attitude  Results 

A3  some  researchers  have  noted,   interactive  video  may  prove  to 
make  more  of  a  difference  in  attitude  than  achievement  (Bosco,  1984; 
Yeany  et  al . ,  1980).    Findings  from  this  study  support  this  contention. 

Although  the  attitude  survey  cannot  accurately  produce  an  overall 
.neasure,   it  i        ssible  to  gen  a  comparative  profile  of  student's 
perc*iptions  of  each  method  by  tallying  survey   "sponses.     Of  28  items 
on  the  survey  concerning  the  perceived  effectiveness,  dependability, 
and  motivation  of  each  method,  16  were  found  to  have  significant 
differences  in  Mann-WIiitney  U  levels  (p.<  .05).     Items  with  the  largest 
significance  levels  generally  also  had  the  greatest  differences  in 
means;  in  fact  the  first  nine  ranks  were  identical  for  both  ranki  ig 
tcethods  (Table  4).     Twenty-three  group  means  were  higher  for  the  xV 


ERIC 


13 


group,  compared  to  5  for  the  LV.     On  agreement  levels,  21  levels  were 
higher  tor  the  IV  group  compared  to  seven  for  the  LV, 

Examining  the  levels  of  significance  and  between  group  differences 
may  be  informative.    Of  the  28  items,  16  items  were  significant  at  the 
.05  level,  and  11  of  those  items  had  a  difference  greater  than  .4  of  a 
category,  all  except  one  of  these  means  were  higher  for  the  IV  group. 
These  need  to  be  considered  with  some  caution.     Five  of  those  items 
involved  questions  which  were  substantially  different  for  each  group. 
These  data  would  indicate  that  student  perception  was  higher  for  the 
interactive  video  method  than  for  the  linear  video  method. 

Of  the  28  items,  between  group  levels  of  agreement  showed 
differences  above  .15  on  six  items,  five  favored  IV  and  one  the  LV 
group.     Of  these  six  Items,  five  also  had  a  between  group  disparity  in 
means  above  .4.    Of  the  seven  testing  related  items,  two  were  above  .15 
in  agreement  differences,  and  both  favored  LV.    Of  21  items  which 
involved  student's  reaction  to  the  same  question,  only  two  had 
differences  in  agreement  levels  above   .15  (.19  and  .15).  This 
indicates  great  similarity  in  item  agreement  levels  between  groups. 

Table  3 

Sample  of  Attitude  Question  Data  Treatment 


5.      While  watching 

this  prog 

ram  1  felt 

cha I lenged 

to  do  my  best. 

Strongly 

Disagree 

Uncertain  Agree 

Strongly  N/A 

disagree 

agree 

IV 

Freq 

0 

1 

5 

51 

7 

<»/ 

/o 

0 

1.5 

7.8 

79.6 

10.9 

C  um .  7o 

0 

1.5 

9.3 

89 

100 

Likert 

Mean  4 

Agreement 

.89 

LV 

Freq 

2 

9 

11 

3S 

4 

•/ 

3.1 

14 

17.1 

59.3 

6.2 

Cum.  7. 

3.1 

17.1 

34.3 

93.7 

100 

' Ikert 

Mean           3 . 

51 

Agreen;ent 

.695 

Between  Group  Differences 

Likert  Mean 
z  score 


.49 
2.90 


Agreement  .195 
Signf  f icance  .002 


Discussion        The  difference  in  between  group  means  on  this  ^tem  was 

considerable  (.49)  and  highly  significant  (.002).     It  would  appear  that 

students  felt  more  challenged,  more  consistently  (agreem^^^nt  difference 
.195)  lo  do  the'r  best  v;ith  the  IV  treatment... 
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Table  4 


Key  Attitude  Differences 
Ranked  by  Degree  of  Significance 


Sig. 

Same 

Item 
ft 

Content 

Diff 

Diff 

N 

v.UIIipULCL     ^Uc^L.lOn^    nSipLUl/  LCVlcW 

questions  would  have  been  helpful 

1  7n 

i  .  /  u 

1 

1 

nf\n  1 

M 

1  A 

methou  of  fee dback  mono t onous /  liked 
a  discussion  after  instruction 

z 

.  UUui 

M 

N 

^  Q 

X  7 

could  have  learned  just  as  well  without 
computer  features/  would  be  better 
with  re V iew  que st ions  or  s imu la t ion 

1  c 
1  •  J 

J 

.  UOC 1 

N 

1  0 

usefulness  of  simulation/  examples  of  27 
different  pictures 

1  0 

1  •  Z 

.0001 

N 

16 

dreaded  missing  review  question/  would 
be  helpful  to  review  sections 

1.18 

5 

.  uUOl 

V 

1 

1  0 

1  J 

enough  control  over  rate  and  sequence 
of  instruction 

0 

.  ouoz 

Y 

1  Q 

lo 

more  interesting  than  traditional  methods 

.  54 

/ 

.  Uui 

V 

1 

Zo 

how  long  could  work  effectivly  with  method 

•  jZ 

Q 
0 

.  uU  Z 

V 

I 

J 

cha 1 lenge d  to  my  be s t 

AO 

0 

no 

V 

9 
z 

mechanical  ma  1 f unc t i ons 

9  S 
—  .  Z  J 

1  7 

.005 

Y 

20 

prefer  method  to  cradtional  instruction 

.48 

10 

.007 

Y 

17 

felt  someone  was  engaged  in  conversation 
with  me 

.43 

11 

.01 

Y 

27 

like  to  learn  other  subjects  with  n.^thod 

.31 

13 

.02 

Y 

10 

too  much  material  presented 

.37 

12 

.03 

Y 

11 

"Gallery"  sequence  useful 

.30 

15 

.03 

Y 

25 

best  approach  to  use  for  learning  photo 

.28 

16 

Key  attitude  differences  concerned  level  of  learner  control,  level 
of  interaction,  and  preference  over  traditional  methods  of  instruction. 
IV  students  indicated  a  substantial  degree  of  agreement  (high  consensus 
level)  on  several  factors  including  the  following  items: 

*  For  learning  about  photography  I  would  prefer  IV  to  traditional 

instruct  ion* 

*  IV  made  it  possible  fc-r  me  to  learn  more  quickly  than  traditional 

methods. 

*  In  view  of  the  time  and  effort  I  put  into  it,  I  was  satisfied  with 

what  I  learned  via  this  method, 

*  I  felt  I  had  enough  control  over  the  rate  and  sequence  of  the 

material . 

*  The  computer-related  features  (review  questions  and  a  picture  taking 

simulation)  were  important  in  helping  me  learn. 

Time  efficiency  was  not  increased  with  interactive  video.     The  LV 
group  all  took  30  minutes  to  watch  the  tape,  the  IV  group's  time  ranged 
from  34  minutes  to  70  minutes  with  an  average  of  49  minutes. 

Possible  Reasons  for  Achievement  Differences 

Practice  and  Repetition*         Many  researchers  have  noted  that  practice 
and  repetition  facilitate  learning.     The  interactive  video  method 
offered  these  attributes  through  the  use  of  review  questions, 
remediation  of  material,  and  options  to  review  sections.     One  could 
argue  that  in  large  part  the  increased  effectiveness  .  f  the  IV  system 
is  due  to  the  student  getting  an  opportunity  to  first  be  quizzed  on  the 
material  (questions  in  the  IV  program  were  different  than  those  on  the 
achievement  test).     Additionally,  the  picture-taking  simulation  offered 
synthesis  of  the  information  and  an  opportunity  to  apply  the 
inf ormat  ion • 

Attent  iveness :  With  lineai  video  the  viewer  can  **tune  out*'  the 

program  or  become  easily  distracted.     The  interactive  video  prograir 
used  in  this  study  required  mastery  learning;   if  the  viewer  did  not  pay 
attention  and  kept  missing  review  questions  it  would  take  longer  to 
proceed  through  the  instruction.     It  would  appear  that  interactive 
video  could  help  increase  concentration  for  viewers  with  low 
motivation,  however  this  may  come  at  the  price  of  increased  anxiety  and 
stress.     Subjects  in  this  study,  for  the  most  part,  did  not  indicate 
that  they  dreaded  missing  a  riview  question,   in  fact  several  students 
commented  that  they  enjoyed  the  challenge,  «nd  the  chance  to  r<iview 
their  understanding  of  the  material  before  being  tested. 

High  Level  of  Interaction:  Many  researchers  have  noted  that 

participatory  experiences  aid  learning.     Anandam  and  Kelly  (1981)  noted 
that  interactive  video  ''changes  the  student  from  passive  observer  to 
active  participant"  (p.  3),    Fowever,  Rosco  (1984)  cautions  that  just 
because  interactive  video  requires  the  student  to  utilize  a  keyboard, 
equating  motor  response  with  active  participation  trivializes  the 
notion  of  what  is  active  and  what  is  passive  in  learning  situations- 
In  some  cases  existing  programs  have  become  "interactive"  by  simply 
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adding  menus  or  review  questions.  In  this  study,  the  program  was 
specifically  designed  to  incorporate  a  high  level  of  interaction, 
including  a  simulation  of  taking  a  picture. 

High  Quality  of  Software:  Ultimately  the  effectiveness  of  any 

medium  will  be  determined  by  the  quality  of  software  utilized.  This 
has  been  evident  in  the  inability  of  educational  films,  television,  and 
possibly  CAI  to  reach  their  fuil  potential.     From  student  responses,  it 
is  apparent  that  there  was  a  high  level  of  satisfaction  with  the 
programs  used  in  this  study.     By  careful  design  both  programs  were 
nearly  identical  in  approach  and  content.    However,  the  interactive 
videotape  utilized  the  attributes  of  computer-related  features. 


Possible  Reasons  for  Att"itude  Difference 

There  vere  16  significant  attitude  differences.     For  purposes  of 
explanation  these  can  be  grouped  into  five  main  areas: 

i.evel  of  Learner  Control:  Quite  evidently  one  factor  in  the 

difference  between  groups  was  that  the  linear  video  group  effectively 
had  no  control  o\*r  rate  or  sequence  o*"  instruction,  while  the 
coraputer-^re  lated  features  of  the  interactive  video  system  afforded  that 
group  some  degree  of  learner  control.     Several  IV  subjects  indicated 
that  they  would  prefer  greater  control  over  program  pacing,  however  78 
pf     cent  of  theiTi  either  agreed  or  strongly  agreed  that  they  felt  enough 
control.     The  issue  of  amount  of  control  to  offer  the  learner  remains  a 
controversial  and  important  issue  for  designers  and  would  make  an 
excellent  topic  for  further  study. 

Opportunity  fov  Review  Questions,  Feedback,  and  Review  Sections: 
The  LV  group  indicated  a  high  desire  for  opportunities  for  review  and 
practice.     This  was  the  most  commonly  cited  shortcoming  of  the  linoar 
video  method.     The  IV  group  exhibited  a  high  level  of  agreement  that 
the  review  questions  and  review  sections  were  helpful  to  them,  and  that 
interaction  with  the  IV  system  was  positive  and  reinforcing. 

Preference  over  Traditional  Instruction:  The  difference  in 

preference  of  the  method  used  over  traditional  methods  (illustrated 
lecture)  favored  the  IV  group  by  .484  and  was  significant  at  the  .005 
lavel.    This  can  be  due  to  several  factors.     Certainly  one  factor  is 
novelty;   the  concept  of  using  a  videotape  recorder  connected  to  a 
microcomputer  was  enticing  to  many  learners.     However,  the  Hawthorne 
effect  may  not  be  germane  because  data  indicated  that  learning  via 
videotape  was  also  novel  to  most  participants.     Students  in  the 
population  typically  had  more  exposure  to  computers  than  instructional 
television.     A  more  important  factor  might  have  been  the  interaction 
afforded  by  the  computer.     Research  on  CAI  has  shown  that  the  holding 
power  of  computers  is  in  large  part  due  to  the  interactive  nature  of 
the  technology.     In  this  study,  the  IV  group  had  a  higher  perception 
that  someone  was  involved  in  a  conversation  with  them  while  receiving 
instruction  than  did  the  LV  group  (difference  .437,  significance  .007). 
It  may  be  interpreted  that  the  computer-assisted  video  instruction  was 
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perceived  as  being  more  hu^iianizing,  individualized,  and  personal  than 
did  the  linear  system. 


Challenge  to  do  Best:  The  IV  group  felt  more  challenged  to  do  their 

best  while  watching         program  than  did  the  LV  group  (difference  .49, 
significance  .002).     It  is  believed  that  this  can  be  directly 
attributed  to  the  IV  stuacnts  needing  to  correctly  answer  review 
questions  to  proceed  with  instruction.     As  mentioned  above,  whether 
this  is  a  trade  off  for  increased  anxiety  is  a  concept  worthy  of 
further  study. 

Time  Able  to  Effectively  use  the  Method:  It  is  interesting  to  note 

that  each  group  felt  they  could  work  effectively  wi;:h  the  method 
approximately  the  amount  of  time  that  it  actually  took  to  watch  the 
program.     For  the  LV  group  this  was  thirty  minutes,  and  for  the  IV 
group  the  average  time  on  instruction  was  about  fifty  minutes.     It  may 
be  that  students  had  the  perception  of  being  able  to  effectively  longer 
work  with  the  IV  system  because  of  being  &n  active  learner.  In 
education  it  is  a  maxim  that  "involvement  precedes  interest",  and  this 
may  have  been  the  case  in  this  study.     It  may  be  discovered  that 
instruction  may  take  longer  with  interactive  video,  but  because 
learners  are  active  and  not  passive,  they  can  work  longer  effectively. 

Implications  for  Further  study 

Retention:  Achievement  measures  in  this  study  measured  only 

imipodiate  recall  of  information.  Testing  took  place  immediately 
following  treatment.  A  larger  question  would  be  the  comparative 
effectiveness  of  methods  in  retention  testing. 

Cost-benefit,  Time  Effectiveness:  Although  this  study  demonstrated 

that  interactive  video  can  increase  instructional  effectiveness,   i*:  did 
not  explore  the  issues  of  cost  or  ^'me  effectiveness.  Interactive 
video  ^s  more  complicated  to  procure  than  almost  any  other  medium  of 
instruction,  and  development  and  production  costs  are  proportionally 
higher,  typically  as  much  as  four  times  greater  than  CAI  or  linear 
video.     However,  the  high  development  costs  can  be  offset  by  repeated 
use  of  the  materials  and  the  automation  of  some  instruction. 
Therefore,   interactive  video  may  be  attractive  to  trainers  who  need  to 
orovide  the  same  instruction  to  large  number  of  persons  at  many 
different  cites. 

Increased  station  cost  is  also  a  drawback  of  interactive  video. 
An  interactive  video  system  costs  more  than  twice  as  much  as  a  linear 
video  system.     This  high  station  cost  may  make  interactive  video 
inappropriate  for  training  or  instructional  situations  where  numerous 
stations  are  ne2ded  and  funds  are  limited. 

This  study  found  an  increase  in  instructional  effectiveness  of  IV 
of  about  17  per  cent  over  LV,     This  increase  may  not  be  large  enough  in 
many  situations  to  justify  the  added  expense.     Time  on  instruction  was 
also  higher  for  the  IV  group  than  Lhe  LV  group,  about  50  per  cent 
higher.     In  many  instances  this  may  not  be  an  acceptable  trade  off. 

Attitude  vs  Achievement:  Researcl"   in  computer-assisted  instruction 
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has  indicated  that  CAI  may  make  a  larger  difference  in  liarner  attitude 
than  in  achievement.    This  may  also  prove  to  Oe  true  for  interactive 
video.     This  study  did  not  compare  the  level  of  significance  between 
the  two  different  research  questions.     It  may  be  that  interactive 
video's  largest  benefit  is  not  its  instructional  effectiveness,  cost 
effectiveness,  or  time  efficacy,  but  in  its  ability  lo  motivate  and 
involve  students. 

Factor  Analysis:         This  study  addressed  the  question  of  how 
interactive  video  compares  to  linear  video  in  instructional 
effectiveness  and  student  perceptions.     A  more  focused  question  is  why 
was  interactive  video  more  effective  than  linear  video.    This  chapter 
has  offered  some  insights  into  probable  causes  for  differences  in 
results  between  the  two  methods.     These  projections  are  based  on:  data 
from  the  attitude  surveys,  student  comments,  personal  experi€nc>2,  and 
intuitive  judgment.    Research  should  be  conducted  to  provide  a  formal 
factor  analysis  to  assess  the  reasons  behind  the  performance  of 
interactive  video.    This  could  be  accomplished  by  altering  the  design 
of  interactive  videotapes  and  testing  single  attributes  of  interactive 
video.     Below  are  several  aspects  which  could  be  varied  to  test  for 
their  individual  effect. 

Varying  Learner  Control:  Throughout  this  paper  the  point  has  been 

reiterated  that  the  amount  of  learner  control  Co  give  students  is  a  key 
issue  for  designers  of  interactive  video  materials.     It  would  be 
beneficial  to  determine  if  there  is  a  direct  relationship^  between  level 
of  learner  control  and  student  achieveme^nt .    This  would  nave 
implications  far  beyond  just  interactive  video  instruction.  With 
interactive  video  this  level  could  be  modified  by  offering  students 
varying  levels  of  control  over  program  pacing,  sequence,  and  feedback. 
Students  could  be  offered  more  control  over  what  method  of  instruction 
to  use  or  whether  review  sections  would  be  optional  or  automatic. 

Varying  Level  of  Interactivity:  Another  interesting  question  would 

be  if  there  is  a  direct  relationship  between  level  of  interactivity  and 
achievement.    By  comparing  programs  with  varying  levels  of 
interactivity  the  effect  of  learner  interaction  on  achievement  could 
possibly  be  isolated.     Variable  factors  could  involve  comparing  the  use 
of  review  questions  to  the  use  of  simulations,  or  the  use  of 
multiple-choice  questions  versus  inquiry  questions. 

Group  Instruction:  This  study  examined  only  individualized 

instruction,  yet  interactive  video  may  have  some  important  implicatior.s 
for  group  instruction  also.     Field  testing  the  materials  utilized  in 
rhis  study  involved  comparing  IV  individualized  instruction  to  IV  used 
in  a  class  environment.     In  the  group  instruction  answers  to  questions 
were  derived  from  a  consensus  of  the  group.     A  short  amount  of  time  was 
allowed  for  questions  and  discussion  with  the  instructor.  Although 
adequate  controls  were  not  maintained,  this  experiment  did  find  that 
the  mean  for  the  IV  group  treatment  was  only  four  points  lower  than 
that  for  the  IV  individualized  method.     Given  the  cost  end  complexity 
of  delivering  individuali^ed  instruction  it  would  be  beneficial  to 
compare  these  two  different  forms  of  delivery. 
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Mechanical  Dependability:  In  this  study  nearly  twenty  per  cent  of 

IV  students  experienced  at  least  some  mechanical  malfunction.    For  many 
training  situations  this  would  be  an  unacceptaoly  large  figure.  Before 
large  scale  implementation  of  interactive  video  instruction  is 
conducted  it  would  be  beneficial  to  determine  the  mechanical 
reliability  of  different  systems. 

Brevity  of  Instruction:  Barbara  Fowler  (1980)   in  her  doctoral 

dissertation  noted  that  due  to  the  brevity  of  instruction 
generalizations  are  limited  to  instruction  of  similar  length.     In  her 
case,  as  well  as  this  study,   instructional  sequences  occurred  over  a  30 
to  50  minute  time  span.     Further  research  shoulu  be  conducted  utilizing 
instruction  given  under  other  time  conditions. 

Replicability;  Research  in  the  social  sciences  has  often  been 

criticized  for  its  lack  of  replication.     Interactive  video  has  been 
especially  susceptible  to  this.     At  the  time  of  this  writing  only  eight 
other  dissertations  on  interactive  video  had  been  written.  Interactive 
video  offers  a  relatively  facile  way  to  replicate  a  study  because  the 
same  materials  can  be  reemployed.     Ir  would  also  be  worthy  of 
investigation  to  administer  the  same  materials  to  different 
populations . 

Different  Populations  and  Subject  Matter:  Interpretation  and 

generalization  of  resulis  from  this  study  is  limited  to  data  obtained 
from  students  enrolled  in  a  teacher  education  program  instructed  in 
basic  photography  skiPF.     Other  studies  should  be  conducted  to 
determine  the  relative  effectiveness  of  interactive  video  with 
different  populations  and  with  different  subjects  of  instruction.  It 
may  He  discovered  that  a  particular  medium  is  good  at  teaching  some 
concepts  to  some  learners  and  not  good  at  others.     This  is  an  area  of 
rese  rch  that  CAI  research  is  just  beginning  to  focus  on. 

Applications  of  Interactive  Video:  Determining  the  proper 

application  of  interactive  video  may  be  as  important  as  investigating 
the  relative  effectiveness  of  the  medium.     As  the  research  in  CAI  and 
instructional  television  has  shown,  proper  design  of  software  and  wise 
application  nf  the  medium  can  be  the  decisive  factor  in  determining  the 
effectiveness  of  a  technology.     A  relevant  question  is  "Should  we  be 
using  interactive  video  based  instruction  or  interactive  video  assisted 
instruction?**.     Research  on  Ckl  has  shown  th£:t  computer-assisted 
in-^truction  has  been  more  effective  than  computer-based  instruction. 
Indeed  in  this  study,   in  which  instruction  was  IV  based,  many  students 
indicated  the  desire  for  discussion,  hands-on  experience,  and  live 
question-and-answer  sessions.     The  attribute-treatment  interaction 
could  be  studied  to  determine  what  kind  of  student  learns  best  from 
interactive  video.     Additionally,   the   level  of  use  needs  to  be 
explored.     There  are  at  least  three  distinct  utilization  levels:  class 
level,  unit  level,  and  lesson  level.     Bosco  feels  that  ultimately 
interactive  video  will  be  more  beneficial  utilized  as  learning  modules 
rather  than  replacing  entire  courses  of  study. 
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Use  in  Conjunction  with  Other  Media:  In  reality,  roost  educators  and 

trainers  draw  on  a  variety  of  roethods  and  media.     Studying  an 
instructional  technology  in  isolation  is  to  some  degree  an  academic 
exercise.     Research  should  be  conducted  to  determine  the  effectiveness 
of  interactive  video  when  used  in  concert  with  other  media.  Although 
it  is  difficult  to  conduct  mu It i-var iate  research,  it  is  essential  th^t 
it  be  done  because  actual  learning  and  teaching  will  ultimately  be 
delivered  in  the  real  world  of  multi-sensory  environments.    Only  then 
will  interactive  video  be  able  to  come  out  of  the  research  lab  and  into 
the  real  world  of  training  and  education. 

Conclusion 


In  this  stu-iy  interactive  video  was  shown  to  be  more  effective 
than  linear 

video  in  teaching  basic  photography     alls  to  students  enrolled  in  a 
teacher  education  program.     Signifi  ant  improvements  were  measured  in 
both  achievement  and  attitude.     This  study  demonstrated  that 
interactive  video  can  '-e  a  very  powerful  and  effective  training  method, 
given  certain  considerations.     These  considerations  are  essential 
issues  in  tht  effective  use        the  medium.     Interactive  video  materials 
must  be  designed  and  produced  to  address  the  unique  characteristics  and 
strengths  of  the  medium;   it  must  be  utilized  effectively,  converging 
the  capabilities  of  che  technology  with  the  nature  of  the  pducational 
task;  and  It  must  be  used  in  conjunction  with  other  media  and  methods, 
caking  into  consideration  the  total  learning  environment  and  learner 
characteristics.     Ultimately,  it  is  the  iribtructional  methods  that 
interactive  video  facilitate  that  will  be  the  strength  of  the  medium. 
In  concluding,   it  is  worth  reiterating  J.J,  Bosco's  advice  to  potential 
designers,  producers,  and  users  of  interactive  video: 

In  order  for  the  technology  to  be  used  effectively,  we  need 
to  get  beyond  the  statements  of  the  first  generation  of 
advocates  to  more  careful  considerations.     If  interactive 
video  is  to  become  a  useful  tool  in  education,  and  net  a  mere 
»-oy  or  plaything,  we  need  reasoned  analysis  as  much  as 
enthus  iasm . 


Hopefully  this  study  will  serve  as  a  pioneering  effort  in  the 
reasoned  analysis  of  interactive  video,  and  w-'U  aid  in  the 
transf orirat ion  or  the  medium  from  technological  plaything  to 
educat ional  tool . 
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Abstract 

There  is  now  substantial  evidence  that  pictures  can  be 
usea  to  facilitate  the  recall  of  information  presented 
in  prose  passages.     There  is  also  evidence  that  the 
presence  of  pictures  in  prose  passages  does  not  hinder 
the  recall  of  information  that  is  not  pictured.     Are  the 
picture  effects  durable  over  longer  periods   (55  days)  of 
time?    Do  pictures  included  in  prose  passages  help  or 
hinder  subjects  recall  of  information  that  is  not 
pictured?    Results  of  this  study  provide  evidence  that 
picture  effects  are  durable.     In  addition,  the  inclusion 
of  pictures  in  prose  passages  did  not  interfere  with  the 
recall  of  iniormation  presented  only  in  the  prose 
passage. 
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Effects  of  Pictures  on  Recall  of  Written  Prose: 
How  Durable  are  Picture  Effects? 
Results  from  prose  learning  studies  examining  the 
contribution  of  pictures  to  the  recall  of  prose 
materials  provide  considerable  empirical  evidence  that 
pictures  can  be  used  to  facilitate  the  recall  of 
information  presented  in  prose  passages   (Alesandrini , 
1984;  Levie  &  Lentz,   1982;  Levin,  1981;  Levin  &  Lasgold, 
1978) .     In  an  integrative  review  of  research  on  the 
effects  of  text  illustrations,  Levie  and  Lentz  (1982) 
report  that  "the  results  of  46  comparisons  of  learning 
illustrated  text  information  from  passages  with  and 
without  pictures  reveal  an  overwhelming  advantage  for 
the  inclusion  of  pictures"   (p.  203)  . 

Levin  (1981)  has  provided  a  theoretical  framework 
which  distinguishes  between  seven  functions  that 
prose-relevant-pictures  may  serve.     The  seven  functions 
identified  by  Levin  include:     decoration^,  remuneration, 
motivation,  reiteration,  representation,  organization , 
interpretation,  and  transformation.     According  to  Levin 
(1981) ,  "Two  of  these  functions   (the  representation 
function  and  the  transformation  function)  have  proved 
useful  in  differentiating  between  the  magnitude  and 
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consistency  of  picture  effects  that  can  be  anticipated 
from  one  prose-learning  study  to  the  next"  (pp. 
225-226)  .     The  function  of  a  representational  picture 
would  be  to  make  the  information  in  the  prose  passage 
more  concrete.     Levin   (1981)   suggests  that  the 
ccntribution  of.  representational  pictures  to  improved 
prose  learning  would  be  moderate.     Pictures  serving  a 
transformation  function  would  make  the  information  in 
the  prose  passages  more  memorable.     The  predicted  prose 
learning  improvement  using  pictures  serving  a 
transformation  function  would  be  substantial  (Levin, 
1981) . 

This  study  investigated  the  possible  contribution 
of  pictures  serving  a  representation  function  to  the 
recall  and  retention  of  information  presented  in  written 
prose  passages.     The  primary  variable  considered  in  this 
study  was  the  durability  of  picture  effects.     Peng  and 
Levin  (1979)   pointed  out  that  "in  order  to  prove 
implications  for  classroom-learrrng  situations,  it  must 
be  demonstrated  that  gains  attributable  to  pictures  are 
not  short-lived"   (^.  39).     Kerst  and  Levin  (1973)  ha/e 
demonstrated  the  durability  of  picture  effects  using  a 
paired-associate  learning  tasks  with  children  as 
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subjects.     Using  a  more  ecolog-' cally  valid  story-recall 
task,  Peng  and  Levin  (1979)  reported  that  picture 
effects  found  with  second  graders  were  durable  over  a 
3-day  period.    Levin  and  Berry  (1980)  also  found  picture 
effects  to  be  durable  over  a  3-day  period.  Using 
representational  pictures^  Anglin  (in  press)  reported 
significant  picture  effects  which  were  durable  over  14 
and  26  days.     Based  on  the  results  of  studies  by  Peng 
and  Levin  (1979),  Levin  and  Berry  (198C) ^  and  Anglin  (in 
press) ,  it  was  hypothesized  for  the  current  study  that 
representational  picti^re  effects  would  be  durable  over  a 
55-day  delay.     It  was  also  pr*=*dicted  that  the  magnitude 
of  the  picture  effects  would  be  moderate  based  on 
Levin's   (1981)   theoretical  discussion  of  potential 
picture  functions. 

A  secondary  variable  considered  in  this  study 
concerned  the  potential  effect  the  presence  of  pictures 
had  on  the  recall  of  information  that  wa.-  not  pictured. 
Based  on  the  results  of  10  studies,  T^vie  and  Lentz 
(1982)   concluded  that  "illustrations  have  no  effect  on 
learning  non-illustrated  text  information"   (p.  203).  A 
closer  examination  of  the  10  studies  reveals  that 
subjects  for  7  of  the  10  studies  were  children  in  grades 
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K-6.     The  three  studies  including  olaer  learners  used 
cartoons  as  illustrations.     Can  the  lack  of  picture 

facilitation  or  interference  found  with  young  children 
be  extended  to  older  learners   (college  students)   if  the 
il lustrations  are  text-redundant  pictures  instead  of 
cartoon  embellishments?    It  was  hypothesized  that  the 
presence  of  pictures  would  neither  facilitate  or  hinder 
subjects  recall  of  information  which  was  '^resented  only 
in  the  passage  and  not  pictured. 

This  study  investigated  the  limits  of  durability 
for  significant  picture  effects.     The  durability  of 
picture  effects  was  examined  over  a  55  day  period.  In 
addition,  the  effects  of  pictures  on  the  recall  of 
information  presented  in  the  text  only  was  examined. 

Method 

Subjects  and  Design 

Subjects  were  30  graduate  students  from  a 
southeastern  university.     The  participants  were  randomly 
assigned  to  one  of  two  groups — prose-plus-picture  (16 
subjects)   and  prose-only  (14  subjects) .     In  the 
prose-plus-picture  group,  subjects  re.ad  the  prose 
passage  and  viewed  a  representational  picture  (line 
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drawing) .     In  the  prose-only  group  the  participants  read 
the  prose  passage  without  the  relevant  picture. 
Materials 

The  three  prose  passages  used  by  Anglin  (in  press) 
were  also  used  in  the  current  study.     The  passages  were 
human  interest  stories  which  varied  in  length  from 
one-half  to  three  quarters  of  a  page,  typed,  and 
double-spaced.     The  passages  were  selected  from  Time,  a 
weekly  news  magazine.     Topics  discussed  in  each  of  the 
three  passages  concerned  skateboarding,  Santa  Claus  and 
Christmas,  and  an  individuals  attempt  to  set  up 
residence  on  a  traffic  island  on  Manhattan. 

The  same  line      awings  used  by  Anglin  (in  press) 
were  used  in  the  current  study  (one  drawing  per 
passage) .     The  drawings  were  designed  to  function  as 
represent* '-.ional  pictures,  i.e.  pictures  whose  function 
is  that        making  the  prose  passage  more  concrete 
(Levin,  1981).     An  example  of  the  picture  used  for  the 
traffic  island  passage  is  presented  in  Figure  1. 


Insert  Figure  1  about  here 
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The  15  paraphrase  questions   (5  per  passage)  used  by 
Anglin   (in  press)  were  also  used  in  this  study.     The  15 
questions  tected  recall  of  information  (text-redundant) 
that  was  presented  in  the  prose  passage  and  represented 
in  the  picture.     An  example  of  one  of  the  Text-redundant 
Test  items  for  the  traffic  island  passage  follows: 

On  what  object  cr  structure  did  the  man 

set  up  residence? 
Five  additional  srort-answer  paraphrase  questions 
were  constructed  for  each  of  the  three  passages   (5  items 
per  passage) .     The  15  new  items  were  designed  to  test 
the  recall  of  informat:.on  which  was  presented  in  the 
prose  passage  that  was  not  represented  in  the 
accompanying  picture.     An  example  of  one  the  the 
Text-only  Test  items  for  the  traffic  island  passage 
follows : 

Where  was  the  man  finally  taken? 
It  was  previously  demonstrated  that  subjects  could 
not  correctly  answer  the  15  questions  which  tested  the 
recall  of  information  which  was  presented  in  the  passage 
and  represented  in  the  pic^uie  without  reading  the  prose 
passage  and/or  viewing  the  picture  (Anglin,  in  press). 
Prior  to  the  administration  of  the  current  experiment. 
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the  15  new  paraphrase  questions  designed  to  test  for 
recall  of  information  presented  in  the  text  but  not 
represented  in  the  pictures  were  administered  to  a  group 
of  12  graduate  students  to  verify  that  these  new 
questions  could  not  be  correctly  answered  by  individuals 
who  had  not  previously  received  any  treatment.  Average 
recall  for  the  12  graduate  students  was  2%. 
Procedure 

Subjects  were  tested  in  a  group  format.     In  both 
the  pr  )S€-plus-picture  and  prose-only  groups^  subjects 
were  instructed  to  read  the  prose  passage  once.     In  the 
prose-plus-picture  condition^  subjects  were  also 
instructed  to  view  the  accompanying  picture.  The 
passage  orders  were  counter-balanced  across  subjects. 
When  a  subject  completed  reading  one  passage  the  10  item 
test  for  that  passage  was  adminirtered .     The  same 
procedure  was  used  for  passages  two  and  three. 
Fifty-five  days  later^  the  subjects  were  tested  in  the 
same  manner  using  the  same  SO-it^m  test   (10  items  per 
passage)   used  in  the  immediate  condition.     In  the 
delayed  testing  condition  subjects  did  not  re-read  the 
stimulus  materials . 
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Results 

The  analyses  were  performed  in  two  stages.  The 
iirst  analysis  examined  the  possible  effect  that 
Treatment  and  Time  of  Tejt  had  on  prose  recall  scores 
for  the  dependent  variable  Text-Redundant  Test  score. 
The  second  analysis  also  examined  the  effect  that 
Treatment  and  Time  of  test  had  on  prose  recall  for  the 
dependent  variable  Text-only  Test  score 

The  first  analysis  was  a  2   (Treatment)  x  2   (Time  of 
Test)   repeated  measures  analysis  of  variance  (ANOVA) 
using  each  subjects'  prose  recall  score  for  the 
Text-redundant  Test  as  the  dependent  variable. 
Treatment  (prose-plus-picture,  prose-only)  was  the 
between-subjects  factor,  while  Time  of  Test  was  the 
wi thin-subjects  factor.     Cell  means  and  standard 
deviations  from  this  analysis  are  presented  in  Table  1. 
The  ANOVA  yielded  significant  main  effects  f ot : 
Treatment,  F(l,   28)   =  9.36,  £  <  .01;  Time  of  Test,  F(l, 
28)   =  98.92,  £  <  .001.     The  two-way  interaction: 
Treatment  by  Time  of  Test  was  not  significant,  F(l,28)  = 
.22,  £  >  .05 
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Insert  Table  1  about  here 


The  marginal  means  for  Treatment  indicated  that 
subjects*  average  recall  was  greater  in  the 
prose-plus-picture  condition  (M  =  iO.38)  than  in  the 
prose-oniy  condition  (M  =  8.45) •     Marginal  means  for  t  t 
within-sub jects  factor  Time  of  Test  indicated  that 
subjects  average  recall  was  areater  in  the  immediate  (M 
=  12.30)   than  in  the  delayed  (M  =  6.40)  testing 
condition.     Given  the  hypothesis  of  durable  picture 
effects,  tests  of  simple  main  effects   (Dixonr  1983)  were 
performed  to  directly  compare  the  prose-plus--picture 
group  with  the  prose-only  group  for  the  immediate  and 
delayed  testing  conditions.     Average  recall  for 
prose-plus  picture  subjects   (M  =  13.18)  was 
significantly  higher   (£  <  .05)   than  average  recall  for 
prose-only  subjects   (M  =  11.53)   in  the  immediate  testing 
condition.     In  the  55-day  delayed  testing  condition,  the 
average  recall  of  prose-plus-picture  subjects   (M  =  7.57) 
was  also  significantly  higher  than  that  of  prose-only 
subjects   (  M  =  5.38)  with  p  <  .05. 
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The  second  analysis  was  a  2   (Treatment)  x  2  (Time 
of  Test)   repeated  measures  analysis  of  variance  using 
each  subjects'  prose  recall  score  for  the  Text-only  Test 
as  the  dependent  variable.     The  15  items  in  the 
Text-only  Test  were  designed  to  measure  the  recall  of 
information  presented  in  the  text  but  not  represented  in 
the  pictures.     Treatment  (prose-plus-picture, 
prose-only)  was  the  between  subjects  factor;     Time  of 
Test  was  the  within-3ub jects  factor.     Cell  means  and 
standard  deviations  frci  the  second  analysis  are 
presented  in  Table  1.     The  ANOVA  yiexJed  a  significant 
main  effect  for  Time  of  Test,  F(l,28)   =  241.69,  £  < 

001.     The  main  effect  Treatment  was  not  significant, 
F(l,28)   =   .32,  £  >  .05.     The  two-way  interaction: 
Treatment  by  Time  of  Test  was  not  significant,  F(l,28)  = 
1.30,  £  >  .05.     The  marginal  means  for  the 
within-sub jects  factor  Time  of  Test  indicated  that 
subjects  average  recall  was  greater  in  the  immediate  (M 
=  11.90)   than  in  the  delayed   (M  =  4.52)  testing 
condition. 

Discussion 

The  two  variables  considered  in  this  study  were:  a) 
durability  of  picture  effects,  and  b)   the  potential 
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effect  the  presence  of  pictures  had  on  recall  of 
information  that  was  not  pictured.    The  discussion 
concerning  the  durability  of  picture  effects  is  based  on 
the  first  analysis  which  included  Text-redundant  Test 
score  as  the  dependent  variable.     The  diccussion  of 
whether  the  presence  of  pictures  facilitate  or  hinder 
subjects'  recall  of  prose  information  that  is  not 
pictured  is  based  on  the  second  analysis.  Text-only 
Test  score  was  the  dependent  variable  for  the  second 
analysis. 

With  respect  to  the  first  and  primary  variable  of 
the  study  (text-redundant  information) ,  the  analysis 
indicated  that  picture  effects  were  present  and  durable 
over  time   (55  days) .     Subjects  who  were  in  the 
prose-plus-picture  condition  remembered  significantly 
more  information  that  was  presented  in  the  passages  and 
represented  in  the  pictures  than  those  subjects  who 
received  the  prose-only  treatment  in  both  the  immediate 
and  delayed   (55  days)   testing  conditions  (Text-redundant 
Test).     Both  treatment  groups'  average  recall  was 
significantly  lower  in  the  delayed  testing  condition. 
The  results  rf  the  analysis  provide  evidence  that 
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picture  effects  are  durable  over  at  least  a  55-day 
delay. 

A  theoretical  explanation  of  higher  recall  scores 
in  prose-plus-picture  (representational  pictures) 
conditions  has  been  suggested  by  Levin  (1981).  Levin 
argues  that  representational  pictures  produce  a  memory 
trace  which  is  more  robust  than  that  associated  with  a 
verbal  representation  of  the  text.     The  more  robust 
trace  would  have  benefits  during  initial  storage  of  the 
information  in  the  passage  as  well  as  later  retrieval  of 
the  passage  information.     Representational  pictures  make 
the  information  in  the  prose  passages  more  specific  and 
provide  a  second  mode  for  the  information  to  be 
represented  in  the  brain  (Levin,  1981). 

Subjects*  average  recall  in  the  prose-plus-picture 
condition  was  11%  -  15%  higher  than  that  of  subjects  in 
the  prose  only-condition.     The  magnitude  of  the  picture 
effects  in  both  the  immediate  and  delayed   (55  days) 
testing  conditions  are  similar  to  those  identified  by 
Anglin  (in  press).     Using  younger  children  as  subjects, 
Levin  and  Berry  (1980)  and  Peng  and  Levin  (19  79)  also 
identified  similar  average  picture  facilitation  which 
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ranged  from  13%  -  20%  higher  for  prose-plus-picture 
groups  than  prose-only  groups. 

The  second  variable  considered  in  this  study  was 
the  potential  effect  the  presence  of  pictures  had  on  the 
recall  of  information  presented  in  prose  passages  which 
was  not  represented  in  pictures.  The  presence  of 
pictures  facilitated  moderately  the  recall  (Text-only 
Test)  of  information  which  was  pr-^sented  only  in  the 
prose  passage  for  the  immediate  testing  condition. 
However,  this  facilitation  was  not  significantly  greater 
for  the  prose-plus-picture  condition.     The  second 
analysis  indicated  that  the  presence  of  pictures  did  not 
significantly  facilitate  or  hinder  recall  of  information 
which  was  presented  only  in  the  prose  passage.  The 
average  recall  of  information  for  subjects  in  the 
prose-plus-picture  condition  did  not  differ 
significantly  with  that  of  subjects  in  the  prose-only 
condition.     However,  subjects'  average  recall  was 
significantly  lower  for  both  treatment  groups  on  the 
delayed  testing  condition. 

In  summary,  the  limits  of  the  durability  of  picture 
effects  was  extended  from  26  days  to  55  days.  Results 
of  this  study  also  support  the  claim  that  the  presence 
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of  representational  pictures  in  prose  passages  does  not 
significantly  facilitate  or  hinder  the  recall  of 
information  in  prose  passages  that  is  not  pictured. 
Further  extension  of  the  limits  of  the  durability  of 
picture  effects  is  justified.     Are  picture  effects 
durable  across  types  of  prose  passages  (narratives, 
human  interest,  etc.)?    Will  the  magnitude  of  picture 
effects  be  similar  across  passage  types?    Will  pictures 
facilitate  the  recall  of  information  presented  in  prose 
passages  for  adult  learners?    Results  of  this  study  and 
knowledge  of  the  effects  of  passage  type  and  audience 
would  provide  practical  information  for  individuals 
concerned  with  the  design  of  instruction. 
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Table  1 

Means  and  Standard  Deviations  of  Subjects'  Prose  Recall 
Scores  by  Treatment,  Time  of  ^'est  e nd  Information 
Tested, 


Treatment 


Immediate 


Delayed  Marginals 


M 

SD 

M 

SD 

M 

Prose-plus- 

Text-redundant 

picture 

13. 

18 

1.75 

7.57 

3.51 

10 

Test 

Prose-only 

11. 

53 

2.02 

5.38 

1.82 

d 

.45 

Marginals 

12. 

30 

2.05 

6.40 

2.91 

Prose-plus- 

Text-only 

picture 

12. 

39 

1.08 

4.43 

3.09 

8 

.41 

Test 

Prone-only 

11. 

47 

2.13 

4.59 

2  26 

8 

.03 

Marginals 

11. 

90 

1.76 

4.52 

2.63 

SD 


:o.95 


Note;     Prose  Recall  scores  can  range  from  0  to  15  for  both  the 
test  measuring  text-redundant  information  ^nd  the  test 
measuring  information  presented  in  the  text  only. 
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Figure  1.    Picture  Accatpanying  One  of  the  Prose  Passages  in 
Experimental  Condition. 
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ABSTRACT 

This  paper  presents  the  problen  of  dlsplsying  oolor  graphics  on 
monoohrone  monitors,  design  rules  for  suoh  grapblo  displays,  and 
current  and  proposed  research  to  exaaine  the  perceptual  a!ul  cognitive 
effects  of  pictures  displayed  Tla  sonoidirciRe  Bonltors*    In  order  to 
eaplrlcally  test  the  usefulness  of  the  proposed  design  principles,  a 
study  was  conducted  to  exaalne  whether  children  could  recognize 
oofflputer  generated  pictures  on  BOuochroBe  Bonltors.    Subjects  were  64 
second,  third,  and  fourth  graders  who  were  randcaly  assigned  to  one  of 
two  conditions.    Children  In  the  first  treatment  were  asked  to 
Identify,  on  a  nonochrone  aonltor,  a  figure  that  was  Initially 
presented  In  Its  original  form  and  then  as  a  redesigned,  more 
distinguishable  figure.    The  redesigned  figure  had  greater 
figure/ground  contrast  because  oolor  substitutions  were  aade  that 
utilized  pixel  patterns  to  provide  contrast  In  the  nonochroaatlc 
display.    The  order  of  plcvure  presentation  was  reversed  for  the 
children  In  the  second  treatnent.    Results  Indicated  that  regardless  of 
grade  ot  FI/FD  characteristics,  children  In  this  study  were  unable  to 
discern  critical  features  of  a  color  graphic  displayed  on  a 
monochrcnatlc  monitor  unless  It  Mas  designed  to  enhance  figure/ground 
separation  (p<.00C1).  lapllcatlont  for  further*  research,  as  suggested 
by  the  results  of  whe  study,  are  discussed. 
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TH£  DISPLAY  OP  COLOR  GRAPHICS  ON  MONOCHROME  MONITORS:    A  CONCERN  FCR 
DESIGNERS  AND  AN  OPPORTUNITY  FOR  RESEARCHERS 


The  proliferation  of  mloroooaputer  geMrated  graphloa  in 
instructional  aof tvara  foroee  new  attention  upon  the  Issues  Involved  In 
picture  coaprAenslon.     Visual  learning  via  computer  enconpasses 
several  elements:    the  learner's  perceptual  qrstea,  the  design  of  the 
visual  nessage,  and  the  nedlun's  aanner  of  conveying  that  aessage. 
While  designers  and  producers  can  feel  confident  that  pictures  will 
usually  enhance  t^elr  aessages,  thqr  have  less  lnf<»witlon  to  assist 
then  In  deteralnlng  the  characteristics  of  pictures  that  aake  then  more 
or  less  appropriate  for  specific  audiences.     Furthermore,  In  the  case 
of  computer  generated  pictures,  the  designer  does  not  have  any  control 
over  the  hardvare  used  for  display. 

A  critical  design  Issue  emerges  when  graphics  Intended  for  color 
display  are  presented  on  monochrome  monitors  or  TV  receivers.  Color 
graphics  that  were  designed  to  be  appealing  and  useful  to  Instruction 
are  found  to  be  less  than  helpful  as  monochromatic  pictures; 
figure/ground  separation  that  Is  aided  by  color  differences  is  lost  In 
mocoohrome  pictures.    Shapes  are  Indiscernible  and  figures  blend  Into 
the  background. 


A  SOLUTION  FOR  THE  DESIGN  OF  PICTURES  FOR  COLOS  AkD  MONOCHROME  DISPLAY 

By  following  dee'gn  rules  developed  by  Baker  (1963),  It  is 
possible  to  design  computer  graphics  that  are  perceptually  salient  for 
both  monochrome  and  color  display.    These  rules,  developed  for  Apple  II 
graphics,  are  outlined  In  Table  I.    The  rules  suggest  which  colors  can 
be  Juxtaposed  In  order  to  allow  for  good  figure/ground  separation. 
Because  of  the  way  monitors  translate  the  display  signal  to  the  screen, 
Apple  II  colors  are  presented  on  a  monochromatic  monitor  In  patterns  of 
pixels  (lighted  dots).    By  consulting  Table  I,  the  designer  can  choose 
which  colors  can  be  Juxtaposed.    The  designer  can  utilize  the  differing 
pixel  patterns  to  provide  contrast  and  to  avoid  similar  patterns  that 
weaken  figure/ground  separation. 


Insert  Table  1  about  here 


Although  these  rules  apply  specifically  to  Apple  II  low  resolution 
colors,  the  principles  g  nerally  apply  to  the  design  of  pictures  for 
other  computers  also.    The  computer  may  not  translate  display  signals 
Into  pixel  patterns,  but  oolors  may  appear  as  shades  of  gray  (or 
wnatever  the  color  of  display  Is. )    The  designer  then  applies  the 
general  rule:    In  order  to  make  the  picture  Interpretable  In  either 
mode,  be  sure  that  Juxtaposltloned  oolors  exhibit  contrasting  shades  of 
gray  In  monochrome.    Regardless  of  the  computer  or  the  display 
hardware,  the  designer  Is  asked  to  be  sensitive  to  the  range  of 
possible  display  hardware  for  color  graphics  In  computer  courseware. 
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THE  STUDY 

The  design  rules  enlnated  from  the  praotloal  notion  of  making 
color  graphlos  In  computer  ooureevare  suitable  for  the  maiqr  monochrome 
monitors  In  use  In  sohools.    Yet  there  was  little  empirical  evidence 
that  following  such  design  rules  would  result  In  pictures  that  were 
more  Intelligible  to  the  children  who  were  the  intended  users  of  the 
courseware*    Belated  research  was  Investigated,  and  a  study  was 
designed  to  empirically  test  the  design  rules  that  were  Intuitively 
needed  and  purposely  formulated*    This  stu4y  Is  reported  In  detail  by 
Baker,  Belland,  and  Cambre  (1985)* 


Review  cf  Belated  Heaearoh 

Several  theoretical  and  applied  areas  provide  insights  into  the 
variables  affecting  picture  comprehension*    These  Include  perceptual 
and  developmental  paychology,  message  design,  and  individual 
differences  within  cognitive  psychology. 

Developmentalists  and  perceptual  psychologists  Identify  experience 
and  maturation  as  important  components  of  visual  perception*    A  nwber 
of  researchers  have  found  that  age  interacts  with  children's  ability  to 
extract  relevant  information  from  pictures*    Children  do  not  interpret 
pictures  in  the  same  manner  as  adults  nor  do  they  obtain  as  much 
information  (Camphel?.,  1981)*    For  instance,  young  children  are  unable 
to  ignore  lrrele>         ifcrmation  and  are  easily  distracted  from 
esssjatial  cues  bj        .iheral  details  (Collins,  1970;  Dwyer,  1978; 
Fleming  &  Levie,  1978)*    Younger  children  have  been  shown  to  prefer 
simpler  pictures  and  to  be  able  to  extract  more  relevant  information 
from  them  than  from  more  complex  pictures  (Travers  &  Alvarado,  1970)* 

Gardner,  Wolf  &  Smith  (1975)  further  observed  that  young 
children's  diffuse  scanning  patterns  and  numerous  small  eye  movements 
affect  their  ability  to  examine  a  picture  holistically*  Travers  & 
Alvarado  (1970)  suggest  that  children  tend  to  perceive  parts  before 
they  perceive  wholes*    Children  in  the  lower  elementary  grades  are 
therefore  likely  to  have  difficulty  perceiving  and  interrelating  the 
various  elements  of  a  picture*    Older  children  are  better  able  to 
perceive  and  describe  an  entire  scene* 

Gibson  (1969:77)  posits  that  e3q)erience  provides  essential 
practice  in  detection,  discrimination,  recognition,  and  identification; 
"•**as  perception  develops  the  organism  comes  to  detect  properties  of 
stimulation  not  previously  detected  even  though  they  may  have  been 
present*    With  growth  and  continued  exposure  to  the  world  of 
atimulation,  perception  becomes  better  differentiated  and  more 
precise* " 

In  addition  to  the  issues  of  developmental  visual  perception, 
critical  features  of  pictures  such  as  figro'e/grcund  are  also  important 
to  picture  comprehension*    Figure/ground  is  so  basic  a  concern  in 
message  design  that  it  is  usually  taken  as  the  starting  point  of  form 
comprehension*    A  German  researcher  named  Rubin  is  credited  with  the 
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first  JHtudles  of  tbe  features  of  figure/ground  organization  in  1921  (of 
Haber  &  Hersbensony  1973:184).    He  obsenred  that  tbe  figure  bas  form  or 
sbapey  vitb  recognizable  "tbinglike*  qualitlesy  vbereas  ground  is 
eitber  formless  or  baving  weaker  or  less  definite  fora  obaraot eristics*. 
Wben  figure/ground  relationships  break  dovny  tbe  result  is  oaaouflage 
or  lack  of  neaning. 

Contour  is  a  critical  element  that  separates  figure  from  groundi 
although  the  oontour  usually  seems  to  belong  to  the  figure. 
Information  or  unoertainty  is  oonoentrated  along  oontours  or  edges. 
Thus 9  if  tbe  oontours  are  not  peroeived  as  edgsa  of  the  flguresi  tbe 
figures  are  difficult  to  see*    Haobberg  (1962:39)  reoommends  tbe 
addition  of  cues  to  enhance  figure/ground  separation  and  make  tbe  edges 
more  disoernable;  among  them  are  making  tbe  figure  more  realistic  or 
iconlCy  using  pigient  or  other  draving  to  simulate  shade  and  shadovst 
using  depth  or  perspectiTe  techniques. 

The  need  for  discernible  edges  of  objects  is  as  important  in 
animated  pictures  as  in  still  pictures.    In  a  discussion  of  psroeptual 
precepts  of  animations  intended  to  facilitate  learning  foK*  children, 
Caldvell  (1978:23)  suggests  that  children  4*8  years  old  will  more 
readily  peroeiTe  drawn  objects  if  they  are  "outlined  vitb  obvious, 
unbroken  boundaries  than  when  the  boundaries  are  broken  or  othervise 
indistinct."  She  further  suggests  that  hri^t  or  veil- illuminated 
objects  vill  be  discriminated  as  the  figure  first. 

Dvyer  (1978)  found  that  individual  differences  such  as 
intelligence,  reading  comprehension,  and  entry  behavior  are  critical 
variables  in  students*  ability  to  learn  from  different  types  of 
pictures.    Cognitive  style  might  also  be  a  differentiating  variable  in 
children's  ability  to  extract  information  from  pictures.  Field 
independent  persons  evidence  tbe  ability  to  experience  items  as 
discrete  from  their  baok0*ound  and  to  overcome  embeddedneas  (Ausburn  & 
Ausburn,  1978).    Furthermore,  tbe  field  independent  person  is  likely  to 
seek  differentiating  information  vitb  veil  dlstiuguished  parts,  vbUe 
tbe  field  dependent  person  is  more  likely  to  have  "fused"  eqMrienoes, 
and  be  unrble  to  separate  items  of  information  from    their  contexts 
(Guilford,  1980).    For  tbe  field  independent  person,  sufficient 
f igui  e/ground  separation  in  a  picture  becomes  even  more  important. 


Perceptual  development,  message  design,  and  individual 
differences  provided  the  framevork  for  the  present  study.    A  computer-* 
generated  picture  of  a  uniooru  vbioh  vas  provided  as  a  revard  picture 
In  a  oommercially-developed  coursevare  package  vas  extracted  so  that  it 
could  be  displayed  independently.    In  this  original  version,  a  critical 
attribute  of  unicorns,  the  singular  born,  vas  barely  distinguishable 
from  tbe  the  background  vben  displiqr^d  on  a  monochromatic  monitor. 
Another  picture  vas  constructed  vitb  precisely  the  same  form  and 
content  be'-  folloving  Baker's  rules.    Consulting  tbe  table  revealed 
that  substitution  of  tvo  colors  vas  required.    The  redesigned  picture 
portrayed  a  unicorn  vhich  looked  tbe  same  as  the  original  picture  on  a 
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color  mooltor  but  hac  an  eaally  dlstlngulabable  horn  on  a  monoohrcnatlo 
monitor*    These  pictures  were  displayed  on  Bonochronrtio  aonitors  to 
subjects  who  were  asked  to  describe  the  content  of  the  pictures* 
Previous  to  adainistering  the  treataents,  the  luminescence  of  the 
screens  vas  measured  and  adjusted  equally  on  the  nonitors  so  contrast 
and  brightness  would  not  affect  results* 

BYPOtheaoB 

The  folloving  hypotheses  guided  the  design  and  interpretation  of 
the  study: 

Hj:    Subjects  will  naae  the  sain  figure  in  the  picture  correctly 
after  they  e3q)erience  the  redesigned  picture*    That  is,  subjects  in  the 
first  treatBent  condition  will  respond  correctly  on  the  second  trial 
and  subjects  in  the  second  treataent  condition  will  respond  oorrectly 
on  the  first  trial* 

Subjects  who  experienced  the  second  treataent  will  be  able  to 
oaae  the  aain  figure  correctly  on  both  trials* 

^:    Subjects  vho  are  field  independent  will  naae  the  main  figure 


^4:  Subjects  frca  hi^er  grades  will  naae  the  main  figure 
oorrectly  nore  frequently  under  either  treataent  condition* 


Subjects  were  dravn  froa  the  second,  third  and  fourth  grade 
classes  of  an  urban  elementary  school*    Within  each  grade  level, 
subjects  were  randoaly  assigned  to  one  of  tvo  treataents*    In  the  first 
treataent,  subjects  were  shown  first  ^^he  original  reward  picture  on  a 
green-screen  (aonochroae)  aonitor  and  asked  to  naae  what  they  saw* 
After  each  subject  had  aade  a  response,  he/she  was  asked  what  else  was 
seen*    Then  the  subject  was  shown  the  redesigned  picture  and  asked  the 
same  questions*    In  the  second  treataent,  subjects  were  shown  the 
pictures  in  the  reverse  order;  the  redesigned  picture  was  shown  first 
and  the  otieXoal  picture  shown  second*    It  was  assuaed  that  the 
identification  of  the  unicorn  in  least  one  of  the  versions  indicated 
that  the  subject  was  faailiar  with  the  concept  "unicorn* "   Only  four  of 
the  subjects  did  not  recognize  the  unicorn  in  either  version* 

In  another  data-gathering  session  approxlBately  a  week  later, 
subjects  were  administered  the  Children's  Eabedded  Figures  Test  (CEFT) 
in  order  to  assess  field  i!yi»*^:xlence*    There  was  a  total  of  64 
aubjecto  that  were  arr^    .  j.n  the  design  as  shown  in  Table  2* 


The  data  analysis  consisted  of  an  multif actor  ANOVA  using  a  least 
squares  solution  to  account  for  unequal  n's*    The  dependent  variable. 
Recognition,  was  scored  in  the  following  aanner:  0  s    No  recognition  of 
either  figure,  1  s  Recognition  of  the  redesigned  figure,  2  = 


Insert  Table  2  about  here 
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Reoognltlon  of  the  original  figure,  and  3  »  Reoognltlon  of  both 
figures. 

Tbe  analysis  of  variance  shoved  a  significant  sain  effect  for  the 
treatment  variable  F(1, 11)^40 .27,  p<.0001.    Subjects  In  Treatment  II 
(zs2.59)  recognized  the  figure  acre  frequently  than  In  Treataent  I 
(xs1.23). 

There  were  no  significant  differences  for  variables  Grade  and 
FI/FD  cognitive  styles,  nor  was  there  any  Interaction  between  or  among 
variables. 


Insert  Table  3  about  here 


DiaQuaaion 

As  was  expected,  subjects  were  able  to  correctly  name  the  aln 
f Igur  e  In  the  picture  more  often  when  presented  the  redesigned  form  or 
when  presentation  of  the  original  picture  followed  the  redesigned  form 
as  In  the  second  trial.    These  results  reiterate  tbe  need  cited  by 
Hoohberg  (1962:39)  to  enhance  the  edges  of  a  figure  so  It  Is 
distinguishable.    While  figure  enhanoement  has  been  determined  to  be 
Important  In  traditional  media,  this  study  shows  such  figure 
enhancement  to  be  at  least  as  Important  with  cmputer  generated 
graphics.    Furthermore,  the  nearly  unanimous  reoognltlon  of  the 
original  unicorn  after  experiencing  the  redesigned  picture  supports 
previous  findings  that  experience  and  practice  increase  the  ability  to 
extract  visual  Information  (Qlbson,  1969:77)* 

Tbe  lack  of  effect  frou  field  Independence/field  dependence  may  be 
explained  by  the  notion  that  this  particular  type  of  cognitive  style 
does  not  take  precedence  over  peroeptual  development.    Cognitive  styles 
remalu  relatively  stable  ov^r  time  and  tasks  (Ausburn  &  Ausburn,  1978). 
On  the  other  hand,  the  ability  to  extract  visual  information  improves 
with  experience  and  maturation.    The  lack  of  effect  from  grade  level 
would  seem  to  negate  developmental  influence  upon  picture 
cofflprehenalon.    However,  a  frequenoy  count  of  the  number  of  times  the 
original  unicorn  was  recognized  in  Treatment  I  showed  a  steadily 
Increasing,  yet  statistically  insignificant,  pattern  of  recognition. 
Such  results  encourage  a  r  plication  of  the  study  with  a  larger  sample 
that  includes  higher  grade  levels  in  addition  to  grades  two,  three,  and 
four. 

Tbe  data  from  this  study  have  meaningful  application  to  the  design 
of  instructional  software  that  incorporates  microcomputer  generated 
graphics.    The  use  of  a  picture  as  either  a  reward  or  as  an  exemplar  is 
futile  if  the  student  cannot  see  what  was  intended  to  be  seen.  An 
earlier  pilot  study  using  the  same  pictures  revealed  that  the 
redesigned  unicorn  had  more  appeal  than  the  "horse",  the  label  given  to 
tbe  original  unicorn  by  the  majority  of  the  subjects.    Additionally,  if 
critical  attributes  are  embedded  In  the  picture,  then  that  picture 
serves  as  a  poor  example.    The  student  could  possibly  assimilate 
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erroneous  information  as  veil  aa  laisa  oritical  infomatln* 

The  produoera  of  Mioroooaputer  generated  graphics  for  ooaputer 
ooursevare  and  educators  vbo  purchase  tlie  software  hare  some  evidence 
via  this  study  that:  1)  alorocoBputer  generated  graphics  intended  for 
color  presentation  but  displayed  on  monochroaatlc  Bonltors  nay  not  have 
sufficient  figure/ground  contrast,  2)  insufficient  figure/ground 
contrast  My  adversely  affect  picture  CMprehension,  and  3)  younger 
children,  at  least  throu^  fourth  grade,  sees  to  lack  the  necessary 
perceptual  maturity  to  overcome  the  effects  of  poorly  discernible 
figures  on  a  monochromatic  graen  screen.    Since  producers  have  no 
control  over  the  display  devices  used  with  softvare,  attention  to  the 
solutions  i'or  generating  graphics  for  both  oolor  and  monochrome  display 
would  lead  to  more  intelligible  pictures  for  children  regardless  of  the 
type  of  monitor  used* 

Several  elements  of  the  stu4y  warrant  further  investigation.  If 
the  sample  were  larger  and  expanded  to  include  kindergarten  through 
sixth  grade,  would  the  very  young  children  not  reoognlxe  the  original 
unicorn  even  after  they  had  seen  the  redesigned  picture  and  would  the 
older  children  be  able  to  recognise  the  unioorn  more  often  even  when 
presented  with  the  original  picture?   In  other  words,  the  practice 
provided  by  the  redesigned  unicorn  may  not  be  enou^  cue  for  the  young 
children  to  prompt  recognition,  and  the  older  children's  perceptual 
maturity  may  be  advanced  enough  that  they  would  not  need  the  exposure 
of  the  redesigned  picture  to  recognise  the  original  one.  Another 
question  involves  the  lack  of  interaction  between  recognition  and 
cognitive  style.    Is  the  inability  of  field  independent  subjects  to 
overcome  embeddedness  a  matter  of  perceptual  Immaturity  as  previously 
discussed  or  is  it  i  irhaps  a  function  of  the  characteristics  of  the 
pictures  used?   A  larger  sample  may  again  provide  additional  cdues  as 
would  trying  different  pictures. 

Other  questions  are  prompted  by  the  results  of  the  study  and 
deserve  consideration  by  researchers  who  want  to  examine  the  properties 
of  visual  perception  via  computer  generated  graphics.    Some  of  these 
questions  include: 

(1)  What  are  the  unique  attributes  of  computer  graphics  display? 

(2)  How  do  these  attributes  compare  to  those  of  traditional  i&edla 
in  terms  of  viewer  perception  and  cognition? 

(3)  Do  the  results  of  the  color/black  and  white  studies  hold  true 
for  computer  generated  pictures? 

The  purpose  of  this  study  was  to  investigate  the  comprehensiblllty 
of  microcomputer  generated  color  graphics  that  are  displayed  on 
monoohromatic  monitors.    Such  comprebensibility  appears  to  be  enhanced 
by  attending  to  the  arrangement  of  elements  in  the  pictures  so  that 
figure/ground  separation  is  apparent  in  either  color  or  monochroce. 
Regardless  of  display  hardware,  pictures  included  in  courseware  can  be 
designed  to  be  comprehensible  by  users,  especially  young  children^ 
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TABLE  1 


£QlfiC  iSbfilfifi  for  MoDOQhroaatlQ  Dlaolav  Using  AddIq  II  MiorooomDutftra 


liCfiUB  1 
Black 


Group  2. 
Magenta 
Dk.  Blue 
D^.  Green 
Broirn 


Group  3. 
Purple 
Md.  B^ue 
Orange 
Lt.  Green 


Grayl* 
Gray2 


Group  i 
Lt.  Blue 
Pink 
Yellow 
Aqua 


White 


•Grayl  and  Gray2  are  nearly  indiscernible  from  each  otberi  and  are  also  very 
doae  in  value  to  White.    Caution  should  be  used  in  Juxtapositioning  these  three 
colors. 


Jlfi^:    FroQ  "Color  Graphics  and  Monochromatic  Display:    Are  Th^  Compatible?"  by 
P.  Baker,  1983t  Educational  Technology.  2^(12),  p.  24.    Copyright  1983  by 
Educational  Technology  Publications,  Inc. 
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Grade  2 


Grade  3 


Grade  4 


TABLE  2 
Distribution  of  Subleota 


I 

II* 

PI 

2 

4 

FD 

6 

6 

FI 

8 

5 

FD 

4 

8 

FI 

5 

5 

FD 

7 

4 

n=32 

ns32 

^Order  of  graphlo  presentation 

I  =  OrlglDHl,  redesigned 

II  s  Redesigned,  original 

Note;    Fran  ^Reoognitlon  of  Computer«Generated  Pictures  on  Monocbromatlo 
Monitors"  by  P.  Baker,  J.  Belland,  and  M.  Cambre,  1985i  Journal  of  Computer^ 
Baaed  Instruction,  12.(4)|  p.  105.    Copyright  1985  by  ADCIS. 
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TABLE  3 

AMOVA  of  Plfura  Banoynltlon  by  Traataant,  Qpaday  ^j;^  FI/PD  IflflftflMMnt 


Souroe 

df 

P 

Treatment 

1 

27  .5625 

40.27* 

Grade 

2 

0.1289 

0.09 

PI/PD 

1 

0.4017 

0.59 

T«Q 

2 

0.4156 

0.30 

T«PI/FD 

1 

0.1436 

0.21 

0«FI/PD 

2 

0.6505 

0.48 

T«Q«PI/PD 

2 

0.8601 

0.63 

Total: 

11 

•p<.0001 


Mote:    Prom  "Reoognltlon  of  Computer^Generated  Pictures  on  Monochrooiatlo 
Monitors"  by  P.  Baker,  J.  Belland,  and  M.  Cambre,  1985f  Journal  of  Computer- 
Baaed  Inatruotionf  12.(4)  t  p.  106.    Ck>pyrlgbt  1985  by  AOCIS. 


54 


INSTRUCTIONAL  FILM  RESEARCH  AND  THE  LEARNER 


BY 


MELVIN  MCKINNEY  BOWIE 


201  Peabody  Hall 
dniversity  of  Arkansas 
Fayettf- ,  i  1 1  e  ,  Arkansas  7J:701 


ERIC 


55 


1 


INSTRUCTIONAL  FILM  RESFARCH  AND  THE  LEARNER 


Research  into  the  value  and  effectiveness  of  motion  pictures  in 
education  has  spanned  more  than  six  decades.    Most  of  the  work  was  done 
prior  to  1970,  with  the  middle  1950's  representing  the  peak  of  activity. 
Hoban  and  van  Ormer  (1971)  reviewed  the  research  conducted  u     ^en  1918 
and  1950.    Since  that  time  there  appears  to  be  no  indepth  search  which 
focuses  entirely  on  the  instructional  film.    This  was  due  largely  to  the 
new  interest  in  instructional  television.   Of  the  nearly  three  hundred 
and  r.hirty-five  studies  analyzed  by  Reid  and  MacLennan  (1067),  only 
thirty  percent  of  them  dealt  with  instrcctional  films,  while  the  other 
two- thirds  were  concerned  with  t.ie  effectiveness  of  instructional 
television.  Other  writers  such  as  Allen  (19601,  Lumsdaine  (196'  . 
Twyford  (1969),  Simonson  (1980),  and  Seibert  and  Ul Imer  (1982)  compiled 
definitive  findings  from  the  research  on  communication  media  in  general. 
Their  writings  did  not  focus  on  work  with  instructional  film  in 
particular. 

If  one  were  to  look  closely  at  ^-fie  research  on  Instructional  film, 
three  distinct  phases  in  the  research  become  apparent.   The  first  phase 
emphasizes  the  capacity  and  capabilities  of  film  as  a  medium  for 
teaching  groups  of  learners  effectively.    These  studies,.^hich  spanned 
roughly  from  the  late  1910 's  to  the  early  19«?n's,  focused  on  the  film 
itself  and  what  it  could  or  cou'd  not  accomplish  as  an  instructional 
tool.    These  studies  primarily  analyzed  the  capacity  of  film  to  teach 
basic  facts  and  concepts  when  compared  to  conventional  teaching.    A  few 
studies  of  that  period  even  compared  film  teaching  tc  teaching  witn 
other  types  of  media  such  as  filmstrips  and  still  photographs.  Later, 
research  efforts  shifted  to  the  manipulationof  certain  film  qualities 
In  an  attempt  to  achieve  a  given  learning  outcome.    In  these  studies, 
conducted  primarily  during  the  1940 's  ind  1950' s,  researc^jers 
experimented  with  the  presence  or  absence  of  color,  sound  effects, 
music,  animation,  and  narrative  structure. 

Then,  around  1960  the  research  slowly  beg?n  to  focus  on  the  learner. 
T;ie  research  question  now  became,  "Who  learns  from  films?"   rather  than. 
Can  films  teach?"  or   "How  do  films  teach?"    TKe  two  latter  questions 
imply  a  sort  of  overt  action  on  the  part  of  the  teacher  in  which 
something  is  done  to  the  learner.   The  first  question  is  more  covert  in 
nature.  Here,  the  burden  for  action  is  placed  on  the  learner.    The  first 
question  analyzes  what  the  learner  brings  to  a  learning  situation,  while 
the  other  two  look  at  vhat  the  teacher  brings  to  an  •'-structional 
situation.    Focus  on  the  learner  thus  presented  res    iChers  with  a 
number  of  new  variables  for  study.  Intelligence,  aptitude,  learning 
style,  personalicy  variables,  maturation,  ethnic  background,  sex.  and 
other  individual  traits  came  under  study  as  these  traits  interacted  with 
the  attributes  of  motion  pictures. 

Figure  1  depicts  the  three  phases  of  instructional  film  research 
conducted  in  this  country  over  the  past  sixty- five  years  as  gleaned  froir. 
the  literatu*'e.   The  illustration  snould  in  no  way  imply  distinct  break: 
in  the  research  efforts,  but  should  be  viewed  as  a  continuous  and 
dynamic  search,  with  much  overlapping  between  jux*jpo<:«»d  phases. 
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The  present  paper  concentrates  on  experimental  studies  which  are 
representative  of  the  third  phase.    These  s'^udies  focus  on  the  the 
question,  "Who  learns  from  film?"    They  were  conducted  primarily  betw.-en 
1960  and  1985  as  this  was  the  period  in  which  the  research  interests 
appear  to  have  sh"»'fted  from  the  film  to  the  student.    The  paper  does 
not,  however,  focus  on  all  individual  differences  that  were  studied,  but 
deals  mainly  with  the  development  of  higher  level  cognitive  skills 
through  the  use  of  films,  the  effects  of  film  viewing  on  individual 
learning  styles  and  other  lc»rner  differences,  and  the  effects  of  film 
viewinq  on  the  self-concepts  of  students.    !t  was  reasoned  that  these 
findings  night  be  of  the  most  value  to  teachers  as  they  seek  solutions 
to  soK?,  of  the  most  challenging  problems  confronting  them  in  practically 
every  classroom. 

Purposes 

This  paper  has  four  (4)  main  purp'^ses.    (1)  It  seeks  to  report  the 
findings  from  instructional  film  research  which  focus  on  the  use  of 
films  in  helping  students  to  master  higher  cognitive  learning, 
particularly  among  the  talented  and  gifted.    Higher  cognitive  learning 
is  concerned  with  mastery  of  problem-solving  and  inquiry  skills  which 
include  hypothesis  generation,  the  generation  of  appropriate  questions, 
the  development  of  observation  skills,  and  hypothesis  testing  and 
evaluation. 

(2)  The  paper  will  summarize  the  available  research  on  the 
interaction  between  film  viewing  and  learning  styles.    While  these 
studies  are  few  in  number,  they  represent  a  promising  approach  to  a 
difficult  questi3n— -"What  works  for  what  type  of  learner?" 

(3)  The  paper  seeks  to  summarize  the  research  findings  on  the  use  of 
films  in  enhancing  the  self-concepts  of  school-age  children.  The  problem 
of  low  self-esteem,  particularly  among  minority  inner-city  students,  has 
long  been  regarded  as  an  obstacle  to  academic  achievement.  Self-concept 
has  also  been  found  to  be  an  important  differential  in  teaching  females 
in  science  and  mathematics  classes. 

(4)  The  paper  will  then  discuss  implications  of  the  research 
findings  md  make  recommendations  for  their  applications  in  a  normal 
classroom.    This  section  emphai'izes  the  fact  that  the  use  of  films  in 
teaching  and  learning  did  not  represent  a  panacea  for  all  of  the  ills  in 
the  classroom,  but  they  d<d  bring  a  fresh  approach  and  need  variety  to 
the  scene. 

The  Lffects  of  Films  on  Higher-Cognitive  Learning 

It  has  generally  been  accepted  that  film  viewing  is  an  effective  and 
efficient  method  for  helping  students  to  increase  their  store  of  basic 
facts  and  concepts.    It  is  not  enough,  however,  to  simply  teach  facts  in 
the  classroom.    Teachers  must  also  help  students  in  learning  broad 
general  principles,  and  in  mastering  inquiry  and  problem-solving  skills 
that  are  so  needed  in  order  to  function  in  a  complex  society.    A  few 
experimental  studies  have  attempted  tj  determine  the  effectiveness  of 
films  in  helping  students  to  master  these  types  of  sliills. 

The  effects  of  informational-expository  and  historical-dramatic 

types  of  films  on  student  abilities  to  master  the  scientific  method  were 
studied  by  Kazem  (1960).    Four  groups  of  high  school  students  were 
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matched  on  pre-test  knowledge,  Intelligence,  reading  ability,  sex,  age, 
and  school  location.    One  group  saw  two  Informational -expository  films, 
A  second  group  saw  two  historical -dramatic  films,  and  a  third  group  saw 
one  of  each  type.    The  control  group  did  not  view  films.    Film  oroups 
significantly  out-scored  the  control  group  on  the  application  of 
knowledge  tests.    The  grouo  viewing  a  combination  of  films  made  more 
gains  that  did  the  group  viewing  historical -dramatic  films,  but  the 
differences  were  not  statistically  significant.    High  ability  students 
made  consistently  higher  scores,  but  students  of  average  intelligence 
made  the  most  gains.    Test  scores  between  the  sexes  did  not  differ. 

At  the  University  of  Illinois,  Suchman  (1961)  believed  that  when 
children  reach  the  operational  stage  of  development,  they  can  be  trained 
.n  the  mastery  of  inquiry  skifls.    Exposing  chi'  .ren  to  a  systematic 
process  of  discovery  is  the  key  to  such  training.    Drawing  on  the 
writings  of  Jeroine  Bruner  and  others,  Suchman  summarized  the  benefits  of 
the  training  (p,151):  (a)  exploration,  manipulation,  and  mastery  are 
1  itrinsically  motivating;  (b)  a  reinforcing  sense  of  power  and 
self-confidence  comes  from  successful  autonomous  discovery;  and  (c)  the 
strategy  of  data  Intake  aiid  processing  has  an  Important  effect  on  the 
productivity  and  depth  of  discovery.     The  author  then  described  the 
results  of  an  experimental  program  called  Inquiry  Training  designed  for 
students  In  the  intermediate  grades. 

Fifty  students  of  high  ability  were  exposed  to  science  problems 
using  filmed  demonstrations.    Students  were  asked  to  identify  objects  in 
the  demonstrations,  verify  conditions  and  changes  In  the  objects  duTing 
the  demonstrations,  and  cite  variables  responsible  for  the  changes. 
Student  responses  were  recorded  on  the  blackboard.   They  were  then  asked 
to  identify  conditions  that  could  affect  the  outcome  of  the 
demonstration,  such  as,  "What  would  happen  if,,,?"  Students  then  had  to 
seek  verification  as  to  why  the  condition  would  affect  the  outcome.  The 
author  explained  the  Importance  of  this  method  (p,162):  "He  learns  that 
every  episode  contains  objects,  that  the  state  of  an  object  at  a  given 
time  can  be  described  by  a  set  of  attendant  conditions,  and  that  any 
change  in  a  condition  is  an  event,,, The  child  learns  to  Identify  first 
all  objects  and  systems,  and  then  to  determine  their  conditions  both  at 
the  beginning  of  the  episode  and  immediately  following  each  Independent 
event,"   The  films  used  in  the  study  were  organized  and  presented  to 
expand  on  previous  learning.    Each  film  Involved  a  new  concept  or  a  new 
variation  of  a  previous  one,    Suchman  felt  that  structuring  the  films  In 
this  manner  was  Important  In  giving  students  a  sense  of  progress. 

Results  of  the  study  were  cited  In  terms  of  individual  progress. 
Students  were  observed  In  the  number  and  types  of  questions  they  asked 
In  problem-solving  situations  after  Inquiry  Training,  Suchman, 
acknowledging  the  wide  range  in  individual  differences,  concluded  that 
this  type  of  training  had  definite  benefits  In  helping  youngsters 
Increase  Inquiry  skills.    The  method  proved  particularly  helpful  with 
gifted  students. 

Al lender  (1968)  described  three  studies  using  inquiry  training  with 
students  In  grades  three  through  seven.    The  studies  used  specially 
developed  films  and  other  materials.    As  a  test  of  inquiry  skills, 
students  were  required  to  role-play  a  small  city  mayor.    Increases  in 
the  desired  behaviors  directly  correlated  with  Increases  In  grade  level, 
but  no  interactions  were  found  with  sex,  intelligence,  or  reading 
ability. 
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Two  studies  conduct-^    by  Salomon  and  Sleber  (1970)  described  a 
method  for  Influencing  the  number  of  relevant  questions  and  hypotheses 
generated  based  on  the  structure  of  the  stimulus.    In  the  first 
experiment,  two  films  were  used,  one  with  structured  sequences,  the 
other  with  unstructured  sequences.    Students  in  one  group  were  asked  to 
write  down  the  number  of  details  observed  In  the  structured  film  and  to 
generate  as  many  hypotheses  as  possible  about  the  plot  of  the 
unstructured  film.    It  was  predicted  that  the  unstructured  film  would 
solicit  more  questions  but  fewer  hypotheses.     In  the  second  experiment, 
subjects   were  asked  to  memorize  as  many  details  as  possible  In  the  film 
scenes  or  to  generate  hypotheses.    The  dependent  measure  was  the  number 
of  times  subjects  asked  to  review  the  film  sequences.    It  was  predicted 
that  the  number  of  details  and  hypotheses  reported  was  directly  related 
to  the  structure  or  lack  of  structure  In  the  stimulus. 

Results  of  the  first  experiment  supported  the  hypothesis. 
Unstructured  films  produced  more  questions  and  generated  more  hypotheses 
than  did  structured  sequences.    The  second  experiment  also  produced 
significant  differences  between  the  two  types  of  sequences  In  favor  of 
the  unstructured  film.    The  authors  concluded  that  uncertainty  and 
Information  searching  are  maximized  when  a  stimulus  suggests  many 
different  responses. 

A  study  which  continued  the  efforts  of  Suchman  (1961)  and  Salomon 
and  Sleber  (1970)  was  done  by  Wright  (1978).    The  same  films  used  by 
Suchman  were  used  in  this  study.    Students  were  asslgned-to  three 
treatment  groups  during  Phase  I  of  the  study.    At  this  time,  subjects 
were  shown  a  film  depicting  a  problem  situation  and  were  tasked  to  list 
as  many  details  and  generate  as  many  hypotheses  for  solutions  as 
possible.    Maximums  were  75  for  the  former  and  5  for  the  latter  task. 
Fourteen  months  later  subjects  used  a  new  set  of  films  to  test  long-term 
retention  of  the  previous  training.    The  study  found  that  students  were 
significantly  more  successful  in  demonstrating  the  types  of  inquiry 
skills  in  which  they  had  receive  Intensive  training.    For  example, 
students  who  had  been  trained  in  attending  cues  to  generate  details 
about  a  problem  were  able  to  list  a  significantly  higher  number  of 
details  in  a  new  problem  situation  than  were  students  who  had  not  had 
the  training.     An  important  conclusion  of  the  study  was  that  it 
"presents  a  model  for  investigating  means  of  improving  basic  inquiry 
skills"  (Wright,  1978,  p. 213).    It  was  a  so  assumed  that  the  development 
of  such  skills  could  conceivably  be  carried  out  in  the  average 
classroom. 

Another  study  of  this  type  was  conducted  by  Pt-rson  (1972).  Here, 
films  were  used  as  verbal  mediators  with  nursing  students  to  help 
sharpen  their  observation  skills.     The  author  designed  the  study  in 
order  to  determine  the  feasibility  of  increasing  the  number  of  real 
observations  reported  by  students  in  a  patient-nurse  contact  and  to 
minimize  the  number  of  inferences  being  reported  as  real  observatio.is. 
It  was  hypothesized  that  students  receiving  filmed  instruction  would 
report  more  observations  and  fewer  inferences  than  would  students  not 
receiving  the  films.    The  study  divided  129  students  into  three 
treatment  groups.    Two  groups  viewed  special  observation  technique 
films,  a  preparatory  film,  and  the  test  film.    A  third  group  saw  only 
the  preparatory  film  before  the  final  test  film.    With  the  test  film, 

students  were  asked  to:  "Please  list  below  all  the  observation  of  fact 
or  occurrence  that  you  noticed  about  the  patient  in  the  filmed  sequence 
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you  just  viewed"  (p. 288).    A  jury  then  classified  responses  as  real 
observation  or  inference.    Using  ANOVA  techniques,  the  researcher  found 
that  there  were  significantly  fewer  Inferences  reported  as  observation 
by  the  nurses  who  had  learned  observing  skills  with  Instructional  films 
as  compared  \j  nurses  who  did  not  see  the  films. 

The  studies  dealing  with  the  development  of  higher  cognitive  skills 
have  been  few  in  number,  but  represent  Important  work  in  the  effective 
use  of  instructional  films.   Research  findings  Indicate  that  it  is 
possible  through  training  to  Increase  the  abilitv  of  students  to  attend 
to  details,  pose  relevant  questions,  and  generate  hypotheses  in  a  given 
proble..:  situation.    These  processes  are  vital  to  'nquiry, 
problem-solving,  and  discovery  learning.   The  rest  arch  Indicates  that 
higher  cognitive  skills  can  be  developed  with  the  use  of  films  in  the 
very  young  as  well  as  in  adults.    At  least  one  sti.dy  (Al lender,  1968), 
found  maturation  as  a  differential  in  learning  hyjothesis  generation. 
The  research  literature,  however,  presented  no  studies  in  which  films 
were  used  to  improve  student  abilities  to  test  hypotheses,  draw 
conclusions,  and  evaluate  conclusions. 


Effects  of  Films  on  Learning  Styles 

A  great  deal  of  attention  in  the  instructional  film  research  after 
1960  focused  on  tne  general  aptitude  and  Intelligence  levels  of  students 
as  they  interact  with  filmed  materials.    Little  work,  however,  has  been 
done  with  films  and  learning  styles.    Hoban  and  van  Ormer  '1970) 
discussed  findings  from  the  1930' s  and  1940's  which  suggested  that  sound 
films  facilitated  learning  in  auditory  type  learners.    May  (1965)  also 
discussed  the  relationship  between  sensory  dominance  and  learning  from 
media.     However,  three  studies  (Thomas,  1972;  Smith,  1973;  Simonson, 
et.al.,  1985)  looked  specifically  at  cognitive  styles  and  film  learning, 
while  one  study  (Snow,  Tiffin  and  Seibert,  1965)  tested  a  broader 
concept  of  individual  differences  and  the  amount  of  learning  from  a 
film.    Two  other  studies  (Salomon,  1972;  Clark,  1973)  which  investigated 
the  effects  of  aptitude  on  film  learning  are  included  here  because  of 
their  unique  contributions  to  an  understanding  of  how  learners  learn 
with  films. 

■^he  nature  of  a  film's  content  on  the  behavior  of  young  children  was 
found  to  interact  with  the  c-gnitive  styles  of  the  learners  (Thomas, 
1972).    One  hundred  and  forty- three  boys,  ages  5  years  to  8  years  were 
divided  into  three  groups.    One  group  watched  an  aggressive  film,  while 
a  second  group  saw  a  nonaggressive  film.    A  control  group  did  not  view 
films.    A  agression  measure  after  the  viewing  found  that  age  and 
cognitive  styles  were  differeiitial  in  the  amount  of  aggressive  behavior 
observed  in  the  "^ubjects.    Younger  boys  were  more  aggressive  than  older 
boys.    Cognitive  styles  became  more  differentiated  with  age. 

Don  Smith  (1973)  measured  400  college  sociology  students  for 
cognitive  style  using  the  Rokeach  dogmatism  scale-Form  E.   Two  groups  of 
200  each  took  identical  final  examinations  after  one  group  had  been 
taught  with  lecture  and  the  other  with  films.    Results  of  the  study 
Indicated  no  differences  in  test  scores  on  patterns  of  cognitive  style, 
GPA,  sex,  or  major  field  of  study.    The  author  pointed  out  that  the 
study  used  group  effects  rather  than  individual  effects  in  an  attempt  to 
f-eplicate  group  problems  usually  confronted  by  the  average  teacher. 
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Thus,  the  results  must  be  interpreted  as  evidence  of  the  general 
effectiveness  of  films  fn  teaching. 

Five  studies  at  Iowa  State  University  looked  at  "learner  aptitude 
interaction  with  media  type  when  attitude  change  is  the  goal  of 
instruction"  (Simonson,  et.al.,  1985,  p,4).     The  studies  specifically 
investigatec*  ;he  characteristics  of  field  dependence  (FD),  field 
independence  (FI),  and  hemi sphericity  as  they  interacted  with  mediated 
messoges.    Cognitive  styles  of  the  participating  students  were  measured 
using  the  Embedded  Figures  Test  for  FD/FI  and  the  Conjugate  Lateral  Eye 
Movement  Test  for  hemisphericity .     The  studies  focused  on  developing 
desired  student  attitudes  toward  soil  conservation,  smoking,  or  disabled 
persons. 

Results  of  two  of  the  studies  indicated  an  interaction  between 
treatment  and  cognitive  style.    Students  who  had  viewed  the  film  on  soil 
conservation  and  who  were  field  Independent  had  higher  attitude  scores 
that  did  the  other  treatment  groups.    Also,  students  who  were  field 
independent  and  viewed  the  film  on  disabled  persons  were  found  the  have 
more  positive  attitudes  toward  the  subject.    Left  brain  dominant 
students  were  found  to  have  more  positive  attitudes  toward  soil 
conservation  than  did  right  brain  dominant  students.    The  authors 
concluded  that  motion  pictures  tended  to  work  generally  best  for  all 
learners  and  for  field  independent  learners  In  particular. 

A  broader  concept  of  individual  differences  and  learning  from  film 
was  studied  by  Snow,  Tiffin  and  Seibert  (1965)  at  Purdue^JUni versity. 
Four  hundred  and  thirty-seven  college  physics  students  were  divided  into 
film  group  and  control  group.    Students  were  assessed  for  the  personal 
variables  of  ascendancy,  responsibility,  emotional  stability,  attitude 
toward  physics,  attitude  toward  film,  numerical  and  verbal  aptitude,  and 
prior  knowledge  of  physics.    Results  of  the  study  indicated  that 
students  who  were  active,  self-assured,  and  independent  performed  better 
with  film  than  with  face-to-face  instruction;   On  the  other  hand, 
students  who  were  low  in  responsibility  and  tended  to  be  unwilling  to 
take  on  independent  learning  activities  preferred  conventional  teaching. 
On  the  intellectual  variables,  students  low  in  aptitude  performed  better 
with  the  film  treatment.    The  authors  speculated  that  viewing  the  film 
allowed  low  aptitude  students  an  opportunity  for  needed  clarification  of 
physics  concepts. 

In  a  discussion  of  the  findings  the  authors  concluded  that 
instructional  method  can  inhibit  learning  in  some  students  while 
facilitating  learning  in  others.    It  was  hoped  that  the  study  would 
provide  grounds  for  decisions  concerning  the  assignment  of  students  to 
alternative  instructional  treatments. 

An  explanation  for  the  interaction  between  aptitude  and  film  viewing 
that  was  found  in  the  study  above  could  lie  in  the  findings  by  Salomon 
(1972).    This  researcher  found  that  8th  and  9th  grou'^^  students 
internal'  ed  and  imitated  visual  codes  from  motion  pictures  according  to 
their  lev  Is  of  mathematical  -^nd  verbal  aptitudes.    It  was  hypothesized 
that  students  low  in  aptitude  would  use  visual  (ues  for  modeling  and 
internalizing  visual  information,  and  that  students  high  in  aptitude 
would  already  have  a  useful  internalization  code  and  would  only  need 
visuals  to  activate  it.    Both  hypotheses  were  partially  supported 
Students  high  in  aptitude  tended  to  notice  fewer  visual  cues  in  a  film 

which  depicted  a  solid  object  being  unfolded  into  space.    On  the 
visualization  test  these  students  were  unable  to  reconstruct  the  object 
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as  well  as  low  aptitude  students.    It  was  suggested  that  low  aptitude 
students  did  not  already  have  a  schematic  code  to  be  supplanted  as  did 
the  high  aptitude  students,  hence  the  greater  attention  to  visual  cues. 

Further  support  for  the  explanation  might  also  be  found  in  a  report 
by  Clark  (1973).    College  students  in  a  psychology  class  were  divided 
into  film  and  control  groups  after  their  scores  on  the  Hidden  Figures 
part  of  the  French  Aptitude  Test  had  been  obtained.    Using  ANOVA 
techniques,  the  researchers  found  that  low  aptitude  students  performed 
significantly  better  with  the  film  than  with  the  teacher. 

The  film  research  on  learning  styles  and  other  learner 
characteristics  suggests  that  filps  are  more  effective  with  students  who 
are  field  independent,  left  brain  dominant,  high  in  responsibility, 
self-assured,  and  who  are  low  in  mathematical  and  verbal  aptitude. 
Face-to-face  instruction  tends  to  work  best  with  passive,  irresponsible, 
and  high  aptitude  students. 


The  Use  of  Films  in  Changing  Self-Concepts 

It  is  generally  accepted  that  students  will  not  learn  well  if  they 
bring  to  the  learning  situation  negative  or  low  concepts  of  themselves. 
Much  work  in  educational  research  has  been  undertaken  in  the  last  twenty 
years  to  help  improve  student  self-esteem.    The  influence  of  film 
viewing  on  the  changing  self-concepts  of  children,  particularly  among 
black  children  who  come  from  low  socio-economic  homes,  has  been  studied 
by  a  number  of  researchers  (Weisgerber  and  Danoff,  1969;  Teaham,  1969; 
Dimas,  1970;  Morin,  1973,  1976).     At  least  one  study  (Paroly,  1983) 
looked  at  the  stereotyping  of  female  social  roles  in  films  designed  for 
elementary  school  children. 

The  study  by  Weisgerber  and  Danoff  (1969)  used  a  mixed  group  of 
black  and  white  students  to  test  changes  in  attitudes  toward  a  black 
hero  (Frederick  Douglass).    It  also  sought  to  discover  if  the  film  had 
any  effect  on  the  self-image  of  the  black  students.    Two  experimental 
groups  viewed  the  film,  while  two  control  groups  did  not.  Eight 
self-concept  instruments  were  administered  prior  to  the  film  and  three 
days  following  the  film.    Responses  were  analyzed  according  to  race, 
sex,  and  socio-economic  status.    The  results  showed  that  both  control 
and  treatment  groups  identified  equally  with  the  hero.    One  has  to 
peculate  about  the  researchers*  choice  of  a  film  hero  since  Frederick 
Douglass  is  so  well-known  and  accepted  by  most  school-age  youngsters. 
Surprisingly,  the  study  did  find  differences  on  the  variable  of  sex. 
Black  females  possessed  more  self-esteem  than  black  males,  while  white 
males  possessed  more  self-esteem  than  did  white  females. 

In  tiiat  same  year,  Teaham  (1969)  conducted  further  research  dealing 
with  the  impact  of  film  on  the  self-concepts  of  minority  children. 
Teaham  hypothesized  that  the  viewing  of  films  about  successful  black 
professionals  would  improve  the  self-concepts  of  black  youth  and  would 
raise  their  levels  of  aspiration.    Studen'.s  in  the  study  came  from  five 
inner  city  schools  in  a  large  midwestern  city.    One  experimental  group 
saw  six  films  about  black  professionals  and  six  films  showing  white 
professionals.    A  second  experimental  group  saw  six  films,  all  showing 
black  professionals.   A  control  group  saw  no  films.  Attitude 
instruments  were  given  one  month  prior  to  the  film  showings  and  one 
month  after  the  films. 
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Students  who  saw  the  films  changed  significantly  in  their  attitudes 
toward  their  own  race  and  toward  themselves.    Students  who  only  saw 
films  with  black  professionals  made  the  most  significant  changes.  The 
latter  finding  was  particularly  true  for  black  males  from  low 
socio-economic  homes.    Students  in  the  control  group  moved  In  the 
opposite  direction,  showing  less  racial  and  self-pride  over  time.  The 
study  also  found  that  black  girls  tended  to  have  lower  goal  aspirations 
than  did  the  boys. 

A  similar  study  by  Dimas  (1970)  divided  fourth  and  sixth  grade  black 
students  into  two  groups.    One  group  viewed  films  about  black  heroes 
such  as  Jackie  Robinson  and  Martin  Luther  King,  Jr,    They  also  saw  film 
segments  of  a  black  middle  class  family.    A  second  nroup  saw  similar 
films,  but  these  films  portrayed  white  models.    The  study  found  that 
students  who  viewed  the  films  with  black  role  models  later  expressed 
more  positive  aspects  of  self-concept  than  did  students  who  viewed  films 
with  white  "^ole  models. 

The  findings  in  the  Teahan  and  Dimas  studies  were  not  replicated  by 
Morin  (1973,  1976).    This  study  sought  to  measure  attitude  changes  of 
black  students  when  exposed  to  a  film  with  either  black  or  white  actors. 
It  was  assumed  that  the  race  of  the  communicator  In  a  film  would  affect 
the  attitudes  of  black  students  toward  that  film  differently, 
particularly  when  the  students  were  stratified  by  socio-economic  status. 
It  was  believed  that  students  from  high  socio-economic  hoines  would 
identify  more  readily  with  white  actors  and  that  the  opposite  would  be 
true  for  students  from  low  socio-economic  homes.    The  hypothesis  was 
rejected.    There  were  no  changes  in  attitudes  among  either  group  toward 
the  films.    Morin  concluded  that  black  children  were  not  overly 
preoccupied  with  the  race  of  the  film  communicator,  therefore  the  race 
of  the  film  actor  does  not  significantly  affect  the  attitudes  of 
minority  children. 

Paroly  (1983)  wondered  about  the  effects  of  educational  films  on  the 
self-concepts  of  female  children.  Analyzing  the  degree  of  female 
stereotyping  in  32  films  produced  for  elementary  school  children  between 
1975  and  1980,  the  Investigator  found  that  male  and  female  roles  were 
not  equal  in  portraying  occupational  or  vocational  behaviors.  Males 
were  more  often  portrayed  in  achievement      leadership  roles,  while 
females  were  more  often  portrayed  in  nurturing  or  submissive  roles.  The 
Paroly  study  suggests  that  because  young  children  tend  to  accept  the 
"authority"  of  films  in  a  learning  situation,  the  use  of  certain  films 
may  work  adversely  in  efforts  to  form  positive  self-concepts  among 
children. 

While  one  study  found  no  Interaction  between  the  self-concepts  of 
minority  children  and  film  role  models,  most  of  the  evidence  supports 
the  presence  of  such  an  interaction.    Films  have  been  found  to  foster 
racial  pride  among  minority  students  and  to  postively  influence  the  way 
these  students  think  of  themselves.    Other  evidence  suggests  the 
presence  of  sex  biases  in  many  Instructional  films  which  are  currently 
being  used  in  elementarj/  schools.    Teachers  are  subsequently  urged  to 
become  aware  of  these  films  and  their  potential  negative  effects  on  the 
self-concepts  of  female  children. 
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Conclusions  and  Implications 

Instructional  film  research  which  focused  more  closely  on  the 
learner  has  provided  the  classroom  practitioner  with  Important  clues  to 
differences  In  learner  characteristics  and  how  these  differences  affect 
learning  under  various  conditions.    While  the  number  of  studies  of  this 
type  has  been  disappointing,  the  work  that  has  been  done  Is  of 
tremendous  value  to  teachers  as  they  seek  effective  methods  of 
Instruction  for  all  types  of  students.    The  popular  acceptance  of  film 
as  a  teaching  and  learning  tool  coupled  with  the  fact  that  most  schools 
have  ready  access  to  some  kind  of  film  collection.  Increases  the  value 
of  the  film  research  literature  as  a  source  of  possible  answers  to  some 
difficult  questions. 

The  following  conclusions  and  "implications  are  drawn  from  the  film 
research  literature: 

1.  Films  are  effective  In  teaching  students  the  skills  of 
Inquiry  learning,  discovery,  and  problem-solving.  Teachers 
who  work  with  gifted  and  talented  students  should  consider 
the  frequent  use  of  appropriately-designed  films, 

2.  Unstructured  films  have  been  found  to  generate  more  relevant 
questions  and  more  hypotheses  In  proulem-sol ving  activities 
than  structured  films.  When  these  higher-cognitive 
activities  are  a  goal  of  Instruction,  teachers  should  seek 
out  and  use  unstructured  films. 

3.  Films  have  been  found  to  be  particularly  effective  In 
teaching  observation  skills  and  in  training  students  to 
attend  to  Important  details.  Teachers  should  consider  the 
use  of  films  for  needed  training  prior  to  assigning  tasks 
which  will  require  the  use  of  these  skills. 

4.  Students  who  are  high  In  mathematical  and  verbal  aptitudes 
tend  to  benefit  less  from  visual  cues  In  films,  while 
students  with  low  aptitudes  tend  to  Imitate  and  Internalize 
such  cues.  Teachers  should,  therefore  provide  students  who 
are  poor  In  mathematical  and  verbal  ability  with  frequent 
opportunities  to  take  advantage  of  film  viewing, 

5.  Films  tend  to  be  more  effective  with  students  who  are 
Influenced  by  Internal  forces  (field  Independent),  are 
logical  and  analytical  (left  brain  dominant),  are 
Independent,  active,  and  are  high  In  personal 
responsibility.  Teachers  are  thus  cautioned  against  the 
consistent  use  of  films  wUl^  students  who  are  passive. 
Irresponsible,  and  who  tend  to  be  more  Influenced  by 
external  forces  (field  dependent). 
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6.  Films  have  been  found  to  positively  influence  student 
self-concepts.  Teachers  should  consider  the  frequent  use  of 
films  depicting  appropriate  role  models  for  deprived 
minority  youngsters  when  working  with  this  type  of  student. 

7.  At  least  one  study  found  the  stereotyping  of  sex  roles  in 
films  for  young  children.  Teachers  should,  therefore,  become 
aware  of  such  biases  and  should  closely  preview  all  films 
before  using,  particularly  with  very  young  children. 
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Rationale 


At  the  1985  AECT  Convention  in  Anaheim,  CA,  the 
authors  presented  a  research  study  titled,  "Varied 
Self-Paced  Micro-Computer  Based  Instructional  Programs 
for  Addressing  Individual  Differences  When  Acquiring 
Different  Levels  of  Instructional  Objectives".    A  refined 
version  of  this  study  was  later  accepted  for  publication 
in  a  special  issue  of  ECTJ  dealing  with  micro-computer 
based  instruction  and  individual  learning  differences. 
The    1985  AECT  RTD  paper  presented  some  unique  results 
regarding  the  design  of  micro-computer  instructional 
programs.    Thet'^  results  tend  to  be  in  opposition  to  past 
instructional  systems  designed  to  address  the  problem  of 
individual  learning  differences  by  the  use  of  a 
self -paced  instructional  method.     However,  the  1985  AECT 
RTD  paper  results  were  consistent  with  current  cognitive 
psychology  principles,  indicating  that  attending  and 
motivation  are  Ptrong  predictors  of  successful  learning 
when  dealing  with  improving  information  processing.  In 
other  words,  what  Wittrock  (1978)  and  others 
(Yerkes-Dodson  Law  in  Travers,  1972;  Zeigarnick  Effect 
and  Ovsiankina  Effect  in  DeCecco,  1963)  have  indicated  is 
that  by  increasing  motivation  and  attention,  learning  or 
infor  -ition  processing  may  also  be  increased.     On  the 
other  hand,  what  self-paced  instructional  systems  (i.e.. 
Skinner's  programmed  learning;  Glaser's  IPI-system;  and 
Postlethwait' s  Audio-Tutorial  System;  in  Cross  1976)  tend 
to  do  is  put  the  locus  of  control  for  pacing  in  the 
learner's  hands.    This  would  tend  to  decrease  external 
control,  not  only  for  pacing,  oat  also  decrease  control 
over  the  manipulation  of  the  student's  attending  behavior 
and  moLivating  the  student.    A  similar  position  has  been 
expressed  by  Carrier  (1?64)  and  Reiser  (1984),  both 
noting  that  learner's  may  not  be  the  best  judges  of  what 
instruction  they  need,  how  much  instruction,  when  to  seek 
instruction,  and  what  to  attend  to  in  an  instructional 
segment. 

The  results  of  the  1985  AECT  RTD  paper  clearly 
indicated  that  a  micro-computer  based  instructional 
program,  that  is  moderately  externally  paced,  allowed  for 
mere  information  to  be  acquired,  and  for  better 
performance  on  higher  level  objectives,  than  both 
self-paced  and  a  more  aggressive  externally-paced 
condition.    Our  results  fit  the  cognitive  psychology 
literature  quite  well,  but  were  in  opposition  to  the 
research  on  self-paced  instruction.     However,  little 


pp.  146-163  of  che  1985  AECT  RTD  Proceedings,  Authors 
Dwyer,  P.,  Taylor,  w.,  Canelos,  J.,  Belland,  J., 
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research  has  been  done  to  date  on  the  issue  of  self-paced 
Instruction  and  micro-computers,  probably  because  of  the 
widely  held  erroneous  assumption  that  self  pacing  is  the 
best  way  to  design  micro-computer  based  instructional 
programs . 

As  can  be  seen  in  the  results  of  our  1985  AECT  RTD 
paper,  summarized  in  the  table  of  means,  Table  6,  the 
external  paced  plus  cognitive  processing  time  condition 
was  superior  to  both  the  self-paced  and  the  external- 
paced,  no  cognitive  processing  time  conditions.  These 
results  are  particularly  significant  when  considering 
that  the  subject's  performance  in  the  external  paced  plus 
cognitive  processing  time  condition  held  constant,  even 
though  intellectual  task  difficulty  increased 
significantly  going  down  t*"^  table.    Table  7  provides  a 
summary  of  the  analysis  of  variance  results  of  the  1985 
AECT  RTD  study. 

Given  the  unique  results  of  the  1985  AECT  RTD  study, 
and  their  significance  in  predicting  how  to  design 
micro-computer  based  instruction,  the  authors  have 
decided  to  conduct  a  series  of  studies  to  further 
investigate  these  results.     Since  the  external  control  of 
pacing  had  such  a  significant  effect  on  learning,  by 
manipulating  attention  and  motivation,  it  is  likely  that 
further  external  controls  can  have  an  effect  upon 
learning  or  information  processing.    These  external 
controls  should  be  designed  to  control  attending  behavior 
and  motivation  when  interacting  with  visual  and  verbal 
information  from  the  micro-computer  based  instru  -♦■ional 
program.     Looking  at  the  table  of  means  in  Table 
indicates  two  distinct  effects  occurring.     First  the 
spatial  problem  free-recall  scores  are  quite  low  when 
compared  to  the  other  test  scores.    This  even  occurred  in 
the  Externally  Paced  plus  Cognitive  Pr'^cessing  Time 
Condition.    This  low  score  probably  occurred  because 
subjects  were  attending  to  mostly  verbal  information  and 
not  the  spatial  or  visual  information  required  to  solve 
the  spatial  free  recall  problem.  As  indicated  in  the  1985 
AECT  RTD  paper,  the  instructional  sequence  presented  the 
subject  with  a  visual  and  a  set  of  verbal  information. 
Each  instructional  question  then  required  the  subject  to 
respond  with  verbal  information.     However,  visual/spatial 
information  was  a  part  of  this  to-be-acquired 
information,  but  the  learner  was  not  directly  forced  to 
attend  to  this  information.    To  externally  control  this 
attending  to  visual  information,  the  instructional 
program  was  changed  to  include  a  5  second  time  delay 
after  the  visual  was  presented,  but  prior  to  any  verbal 
information  being  presented.     The  presence  of  visual/ 
spatial  information,  and  the  absence  of  verbal 
information  should  presumably  direct  the  learner's 
attention  to  the  visual  information.    To  further  control 
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the  learning  of  spatial  information,  every  5  to  7 
instructional  displays  the  learner  was  given  a  cue  to  try 
to  form  a  mental  image  of  the  visual/spatial  information 
seen  so  far.     This  was  done  by  including  a  special 
instructional  display  th?t  formed  an  outline  of  the 
heart,  with  verbal  directions  that  asked  the  learner  to 
try  to  fill  in  the  parts  he  or  she  had  already  seen  by 
formina  a  mental  image.    The  second  effect  noted  in  Table 
6  is  the  wide  range  of  scores  across  the  test  types  :n 
the  Self-Paced  and  External  Paced  No  Cognitive  Pro^^3sing 
Condition,     It  was  felt  that  the  5  second  visual  ay 
variable  would  tend  to  level  off  these  scores  by  fc.cing 
subjects  to  more  carefully  attend  to  information 
presented.    While  these  external  manipulations  of  a  5 
second  visual  delay  and  a  cue  to  image,  seem  like  a  small 
amount  of  external  control,  recall  that  a  7  second  delay 
caused  the  differences  in  scores  between  the  Ep  +  Cp,  Sp 
and  Ep  -  Cp  conditions  the  1985  study.     As  indicated  in 
the  1985  AECr  RTD  paper,  cognitive  style  variables  should 
be  examined  in  terms  of  effects  upon  learning  when 
different  micro-computer  based  instructional  conditions 
are  used.    The  cognitive  style  variable  examined  in  this 
study  was  reflectivity  and  impulsivity.    A  final  lable 
examined  was  the  effect  upon  learning  of  a  simple  agery 
strategy  to  further  control  information  processing.  The 
four  theoretical  hypothesis  examined  in  this  study  were: 

1)  The  external  control  of  a  5  second  visual  delay 
will  improve  overall  learning  from  the 
instructional  programs  and  particularly  the 
processing  of  visual  and  spatial  information, 
for  use  on  spatial  learning  tasks. 

2)  A  cue  to  form  an  image  will  improve  learning  on 
spatial  tasks  when  compared  to  those  subjects 
without  imaging  cues. 

3)  Reflectives  will  tend  to  respond  more  favorably 
to  micro-computer  instructional  programs  than 
impulsive  cognitive  styles  who  probably  require 
more  external  control  than  CAI  can  afford. 

4)  Imaging  training  will  improve  visual  learning 
overall  if  given  prior  to  working  with  CAI. 


Experimental  Derign 

The  present   study  is  a  research  in  progress  and  was 
completed  on  Novt.   ^er  8  and  9,  1985,  at  Ohio  State 
University.     The  data  analysis  completed  to  date  appears 
in  Tables  1  thru  5,  and  Figure  1.     This  analysis  can  be 
compared  to  the  results  of  the  1985  AECT  RTD  stud  '  found 
in  Tables  6  and  7.     Further  analysis  will  be  done  with 
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the  resulting  data,  and  the  ref lectivity-impulsivity  data 
will  be  added  to  this  fu.  cher  analysis  in  addition  to  a 
more  comprehensive  literature  review  on  this  cognitive 
variable.    Further,  a  complete  description  of  the 
instructional  programs  and  test  types/intellectual  tasks 
will  be  not  included  in  this  review  but  can  be  found  in 
the  1985  AECT  RTD  paper,  pp.  146-163.  However, 
modifications  in  those  micro-computer  based  instructional 
programs  will  be  considered. 

The  experimental  design  appears  in  Figure  2,  and  is 
a  (4  X  5  X  2  X  2)  design.     There  are  4  basic 
instructional  conditions,  as  indicated  earlier,  a  b 
second  visual  delay  was  added  to  each  instructional 
condition  to  improve  attending  to  visual  information. 
The  instructional  programs  are  the  same  used  in  the  1985 
AECT  RTD  study.    However,  the  external  paced  no  cognitive 
processing  time  condition  is  not  used  in  this  study.  The 
programs  are  micro-computer  instructional  programs 
designed  to  teach  the  names  of  the  parts  of  the  heart, 
the  heart  phases  and  operations.    There  are  57 
instructional  frames  in  each  instructional  program,  and 
these  are  identical  to  the  1985  AECT  RTD  study  programs. 
The  only  overall  change  in  each  instructional  condition 
was  the  addition  of  the  5  second  visual  delay,  this  delay 
occurs  in  the  following  manner.     Each  instructional 
display  consists  of  a  visual  of  the  heart  and  relevant 
heart  parts  and  verbal  labels,  then  under  the  visual  a 
segment  of  verbal  information  appears  describing  the 
visua]  and  verbal  labels.    This  information  is  then 
removed  from  the  CRT  screen,  a  study  question  appears, 
and  the  learner  types  in  the  appropriate  answer.  To 
force  the  learner  to  attend  more  carefully  to  the  visual 
information,  a  5  second  visual  delay  occurs  after  the 
heart  visual  and  part  labels  appear  on  the  screen,  prior 
to  any  verbal  instruction  appearing  under  the  visual.  At 
this  point,  the  learner  is  forced  to  attend  to  the  vicual 
information.    After  several  frames  the  learner  seems  to 
realize  that  this  visual  information  must  be  important. 
Two  of  the  instructional  conditions  provided  an  imaging 
cue,  that  helped  the  learner  recall  prior  visual 
information  during  the  instructional  sequence.  This 
imaging  cue  occurred  every  5  to  7  instructional  displays 
in    the  sequence  of  57  displays.     The  image  caes 
consisted  of  an  outline  visual  of  the  heart  appearing  on 
the  screen,  then  a  verbal  segment  told  the  learner  to  try 
to  fill  in  the  outline  drawing  with  heart  parts  he  or  she 
had  already  seen  by  forming  an  image  in  the  mind.  The 
learner  had  as  much  time  as  needed  to  think  about  this 
image.     The  4  basic  instructional  programs  were  the: 

(1)     Self-^Paced  Instruction  -  5  se*^.  delay  -  no 
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(2)  Self-Paced  Instruction  -  5  sec.  delay  - 
imaging  cue 

(3)  External-Paced  Instruction  -  5  sec.  delay  -  no 
imaging  cue 

(4)  External-Paced  Instruction  -  5  sec.  delay  - 
imaging  cue 

There  were  5  types  of  tests  or  intellectual  tasks. 
These  tests  were  identical  to  those  given  in  the  1985 
AECT  RTD  study  and  are  described  in  detail  in  that  study. 
The  tests  represent  specific  intellectual  tasks,  and  were 
designed  to  range  in  difficulty  from  a  simple  task  to  a 
difficult  task  and  were  called: 

(1)  List  learning  test  Less  Difficult 

(2)  Spatial  learning  test,  cued  recall 

(3)  Simple  concept  learning  test 

(4)  Complex  concept  learning  test 

(5)  Spatial  problem  test,  free  recall 

More  Difficult 

The  cognitive  variable  was  the  reflectivity  versus 
impulsivity  variable.     As  the  name  implies,  the 
reflective  cognitive  style  tends  to  take  more  time  with 
information  based  decisions,  while  the  impulsive 
cognitive  style  tends  to  have  as  the  main  goal;  "getting 
tnings  done  quickly."     ref lectivity-impulsivity  was 
determined  using  Barratt's  test,  (Barratt  and  Patton, 
1983).     The  test  was  given  on-line  to  subjects  prior  to 
beginning  the  instructional  programs,  and  scores  were 
recorded  for  each  subject.    While  the  ref lectivity- 
impulsivity  variable  data  has  been  collected,  the  data 
has  not  yet  been  added  to  the  currently  analyzed  data. 
It  was  assumed  that  reflectives  may  be  more  adept  at 
using  micro-computer  based  instruction  than  impulsives, 
indicating  that  the  impulsive  cognitive  style  may  need 
more  external  control  in  the  learning  environment  than 
typical  methods  of  CAI  can  ^rovide. 

The  last  variable  examined  was  the  imagery  tr^  :ing 
variable.     It  is  likely  that  training  subjects  to  torm 
images  would  help  them  acquire  vi?^ual  information  better, 
than  no  such  prior  training.     The  image  training  group 
had  a  brief  workcihop  on  how  to  form  mental  images  by 
hearing  an  explanation  of  the  value  of  imagery  in 
learning,  and  prarrtici^ig  forming  images  of  objects.  The 
workshop  consisted  of  a  video-taped  demonstration  and 
explanation  of  an  imagery  strategy. 

Subjects  participating  in  the  study  were  200 
freshmen  from  Ohio  State  University.     Subjects  received 
points  toward  their  final  grade  in  freshmen  psychology 
for  participation.     Subjects  were  randomly  c.3signed  to 
the  4  instructional  conditions,  and  from  there  randomly 
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assigned  to  the  imagery  training  and  no  training  groups. 
Subjects  were  run  through  the  study  conditions  over  a 
period  of  two  days.     Data  was  calculated  on  168  subjects 
who  completed  the  study,  yielding  an  equal  42  subjects  in 
each  of  the  4  instructional  conditions. 


Preliminary  Analysis  and  Results 

The  analysis  was  conducted  using  a  4  x  5  x  2 
analysis  of  variance  with  repeated  measures.    A  complete 
analysis  using  the  ref lectivity-impulsivity  variable  will 
be  conducced  at  a  later  time,  and  this  will  yield  the 
complete  4x5x2x2  experimental  design  found  in 
Figure  2.    A  table  of  means  for  the  overall  experimental 
design  can  be  found  in  Table  1. 

The  analysis  of  variance    is  summerized  in  Table  4. 
Table  4  indicates  thai:  the  significant  differences  found 
last  year  (see  Table  7)  on  the  instructional  type 
condition  have  been  eliminated.    Looking  at  the  pattern 
of  means  found  in  Table  2  indicates  that  the  differences 
across  test  conditions  have  been  leveled  off  to  enough  of 
an  extent  to  eliminate  a  significant  difference  on  the 
instructional  conditions.     In  other  words,  in  a  general 
sense,  the  Self-Paced  and  External-Paced  instructional 
conditions  provided  for  similar  test  performance.  It 
should  be  noted  that  the  External-Paced  condition  in  the 
present  study  is  the  External-Paced  plus  Cognitive 
Processing  Condition  from  the  1985  study,  the  External 
Paced  No  Cognitive  Processing  condition  was  not  used.  It 
is  likely  that  this  overall  improvement  in  test 
performance  over  last  years  study  was  a  result  of  adding 
the  5  second  visual  delay  to  each  of  the  instructional 
conditions.    This  visual  delay  forced  the  subject  to 
concentrate  on  the  visual  display  of  the  heart  and 
labels,  thus  improving  overall  information  processing. 
Comparing  Table  6  and  Table  2,  emphasizes  this  overall 
performance  difference  between  the  1985  AECT  RTD  study 
and  the  present  study.     Looking  at  Table  6  and  Table  2 
also  reveals  the  significant  increase  in  scores  on  the 
Spatial  Learning  Problem  test  in  the  present  study.  Note 
tnat  the  average  score  on  this  test  in  the  present  studv 
was  9.71  points,  compared  to  6.55  points  in  the  1985 
AECT  RTD  study.     It  is  likely  that  the  5  second  visual 
delay  caused  the  learner  to  attend  more  carefully  to 
visual/spatial  information,  thus  improving  scores  on  the 
Spatial  Learning  Problem  Test. 

Significant  differences  are  found  between  test 
types,  or  intellectual  tasks  (Table  4).  These 
differences  are  further  analyzed  in  Table  5,  and  the 
results  indicate  that  t:he  tests  do  range  in  difficulty, 
making  the  spatial  learning  problem  free  recall,  the  most 
difficult  task. 
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Of  particular  interest  is  the  interaction  f^>und  in 
Table  4  between  test  type  and  instructional  condition • 
This  interaction  is  displayed  in  Figure  1,  and  the  means 
involved  in  this  interaction  are  presented  in  Table  2,  A 
Tukey  method  has  been  conducted  on  the  means  involved  in 
this  significant  interaction.     The  complete  analysis  of 
these  means  will  not  be  presented  here,  however,  the 
source  of  the  interaction  was  the  different  pattern  of 
means  occurring  in  the  External-Paced  Image  Cue  condition. 
The  scores  in  this  condition  tended  to  be  higher  than  the 
other  three  conditions,  particularly  the  score  on  th.> 
Spatial  Problem  Free  Recall  (see  Figure  I),  Similarly, 
the  Self-Paced  Image  Cue  condition  yielded  a  higher  score 
on  the  Spatial  Problem  Free  Recall  Test,  contributinc  to 
this  interaction.     Further  analysis  of  this  interaction 
is  planned  in  a  future  presentation  of  the  results  of 
this  study. 


Conclusions 

The  preliminary  results  of  this  study  indicate  that 
external  control  of  instructional  conditions,  in 
micro-computer  based  instruction,  can  improve  information 
processing.    These  results  further  support  the  notion 
thai  putting  the  learner  in  complete  control  of 
instruction,  via  a  self-paced  condition,  may  not  be  the 
best  teaching  method  for  CAI.     Specifically,  these 
preliminary  results  supported  our  first  hypothesis, 
indicating  that  a  5  second  delay  after  visual  inforir  tion 
is  presented  on  the  CRT  can  improve  learning  of  visual 
and  spatial  information.    This  5  second  delay  probably 
caused  the  learner  to  attend  more  carefully  to  visual 
information  and  therefore  process  more  visual  information. 
While  a  5  second  delay  seems  slight,  it  did  improve 
scores  on  the  Snatial  Problem  free  recall  test  over  the 
1985  AECT  RTD  study,  and  tended  to  improve  test  scores  in 
general.    Additionally,  support  was  found  for  the  second 
hypothesis,  indicating  that  a  cue  to  form  images,  as  a 
form  of  external  control,  i-uproved  performance  on  the 
Spatial  Learning  Problem.     Students  may  need  this  type  of 
cueing  to  help  them  process  information  and  tell  them 
what  is  important  and  needs  to  be  acquired  in  the 
instructional  sequence.     The  imagery  training  probably 
did  not  have  a  noticeable  effect  because  of  the 
beneficial  effects  of  the  5  second  delay  and  image 
cueing. 

Overall,  the  External -Pacea  condition  plus 
cognitive  processing  time  (from  the  1985  AECT  RTD  study) 
with  an  imaging  cue,  was  the  better  of  the  three 
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micro-computer  based  instructional  conditions.  Furthe 
analysis  is  planned  by  adding  the  ref lectivi ty- 
impulsivity  variable^  and  further  analysis  of  the 
instruction  by  test  interaction  will  be  carried  out  in 
future  study  presenting  this  data. 
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Self-Paced 

5  sec 

Delay 
(No  Image 
Cue) 

Self-Paced 
S  sec . 
Delay 
(Impge 
Cue) 

External-Paced 
5  sec. 
Delay 
(No  Image 
Cue) 

Externcil-Paced 
5  sec. 
Delay 
(Image 
Cue) 

X 

1-5 

Image 
Trainee 

Not 
Trained 

Image 
Trainee 

Not 
Irained 

Image!  Not 
Trained!  Trained 

Image 
Trained 

Not 
Trained 

List 
Learning 
Ttest 

11.81 

10.67 

13.10 

14.48 

11.86 

13.67 

15.0 

12.86 

12.93 

Spatial 
Learning 
Test 

13.38 

12.86 

12.10 

14.48 

12.71 

14.67 

14.14 

14.33 

13.69 

Sinple 
Concept 

11.91 

11.81 

11.29 

12.33 

11.52 

12.86 

11.67 

13.33 

12.09 

Conplex 
Concept 
Test 

11.91 

11.14 

10.86 

11.57 

11.86 

11.91 

11.76 

12.48 

11.70 

Spatial 
Probleni 

Free 
Recall 

9.19 

8.10 

10.29 

10.52 

9.43 

9.67 

10.71 

9.76 

9.71 

X... IT/NIT 

11.64 

10.91 

11. /O 

..70 

11.48 

12.55 

12.66 

12.55 

X, . .SP/EP 

11.28 

12.20 

12.01 

12.61 

Image  Training   X....^  =  11.87 

No  Image  Training   X...  =  12.18 

Table  1:    Overall  Table  of  Means 
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Instruction 
ondition 
Learning 
Task 

Self-Paced 
No-Image 
Cue 

Self-Paced 
Image 
Cue 

External-Paced 
No-Image 
Cue 

External-Paced 
Image 
Cue 

1)  List 
Learn 

11.24 

13.79 

12.76 

13.93 

2)  Spatial 
Cued 

13.12 

13.71 

13.69 

14.24 

3)  Simple 
Concept 

11.86 

11.81 

LZ  .  DU 

4)  Complex 
Concept 

11.52 

^  — 

11.26 

11.88 

12.11 

5)  Spatial 
Free 

8.64 

10.41 

9.55 

10.24 

Table  2;     Instructional  Condition  X  Test- 
Learning  Task  Interaction  Means 
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Image 

No  Image 

Training 

Training 

List 

Learn 

12,94 

12,91 

Spatial 

Cued 

13,30 

14,08 

Simple 

Concept 

11,60 

12,58 

Complex 

Concept 

11,60 

11,80 

Spatial 

Free 

9,91 

9,51 

Table  3 ;     Learning  Task  X  Image  Type 
"Almost  Interaction"  Means 
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SI 


Source  Mean  Sq. 
(BG) 

Instruction  Type  (A)  64.814 

Image  Type  (B)  20.430 

(A)  X  (B)  40.321 

Error  59.372 


Df         F-Hatio  Probability 


3 
1 
3 

160 


1.092 
0.344 
0.679 


.35 
.56 
.57 


(WG) 
Test  Type  (C) 
(A)  X  (C) 
(P)  X  (C) 
(A)  X   (B)   X  (C) 
Er  ror 


380.909 
11.503 
13.683 
7.417 
6.022 


4 

12 
4 

12 
640 


63.258 
1.910 
2.272 
1.232 


.0001 
.03 
.06 
.26 


Table  4;     Analysis  of  Variance  Results; 
2x4x5  Design 
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(1)    List  Learning 

Test  12.  S:. 


(2) 

Spatial  Learning 

Cued  Test  13. 

69 

(3) 

Simple  O.  ncep*-. 

Learnina  Test 

12. 

09 

(4, 

.oinples  Concept- 

Learning  Test 

11. 

07 

Spatial  Learning 

Problem  Test  9. 

71 

12.93  ~ 

13.69 

= 

.76 

12.93  - 

12.09 

.84 

12.93  - 

"  07 

1.86 

12.93  - 

9.71 

3.22* 

13.69  - 

12.09 

1:1 

13.69  - 

11.07 

^  62* 

13.69  - 

9.71 

3.98* 

^2.09  - 

11.07 

1.C2 

12.09  - 

9-71 

2.38* 

11.07  - 

9.71 

i.36 

( *Signif icant  at  .05  alpha) 


Tahle  5;     Mean  Differennes.  Test  Type 
or  Learning  Task,  Usim.,  T-Method 
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Self- 
Paced 

External 
Pace,  Norm 
Reading 

External 
Pace 
No  Cp 

Control 

WG,  X... 

Control 
In 

List 
Learning 

12.36 

12.48 

11.84 

1.92 

9.65 

Spati  1 
Learning 
Cued 

12.32 

13.60 

10.64 

5.68 

10.56 

Simple 
Concept 
Test 

11.00 

12.80 

8.88 

7.12 

9.95 

CompleA 
concep  L. 
Test 

X  U  .  4  U 

1^  .  04 

Q  AO 

0.30 

1  A    A  ^ 

Suatial 
Problem 
Freo-Recall 

6.  76 

8.60 

4.28 

.88 

5.13 

BG «  X • • • 

10.67 

,2.22 

9.02 

4.43 

Avg.  Time 

Cverdii 

50,3b 
,min. 

44.r)4 
min. 

45.04 
min . 

n/a 

Table  6;     Resulting  Test  Means  and  Overall  Time  for 
Each  Instructional  Program,  1985  AECT  -  RTD  Study 
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oource 

Mean  Sq. 

Df 

f-ratio 

Probability 

BETWEEN  GROUPS 

Instruction/ 
Pacing  (A) 

14C4.359 

3 

45.875 

.001 

Error 

30.613 

96 

WITHIN  GROUPS 

Learning  Task, 
Test  (B) 

493.917 

4 

99.785 

.001 

(A)  X  (B) 

51.901 

12 

10.485 

.001 

Error 

4.949 

384 

Table  7;     Resulting  Lindquist  I,  4  x  5 
Analysis  of  Variance  Data,  1985  AECT  -  RTD  Study 
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Figure  1;     Graphic  of  Interaction; 
Instructional  Condition  x  Test  Type 


SP,  IC  =  Self-Paced,   Image  Cue 

SP,  NIC  =  Self -Paced,  No  Image  Cue 

EP,  IC  =  External-Paced,  Image  Cue 

EP,  NIC  =  External-Paced,  No  Irage  Cu 
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Self ^Paced 
Instruction 
5  sec.  Delay 
No  Image 
Cue 

Self-Paced 
Instruction 
5  sec.  Delay 
Image 
Cue 

External-Paced 
Instruction 
5  sec,  Dela^ 
No  nage 
Cue 

External-Paced 
Instruction 
5  sec.  Delay 
Image 
Cue 

Image 
Ti;ained 

Not 
Trained 

Image 
Trained 

Not 
Trained 

Image 
Trained 

Not 
Trained 

Image 
Trained 

Not 
Trainee 

List 
Learning 
Test 

Ref* 

R 

R 

R 

R 

R 

R 

R 

.  Imp 

I 

I 

I 

I 

I 

I 

Spatial 
Learning 
Test 

Simple 
Concept 
Test 

Complex 
Concept 
Test 

Spatial 
Problem 

Free 
Recall 

..  .  1 

1 

^Cognitive  Variable  -  Reflectivity  vs.  Impulsivity 
not  yet  analyzed  for  this  write-ap 


Figure  2:     Complete  Experimental  Design; 
2x2  X  4  X  5  Analysis  of  Variance 
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AN  ASSESSMENT   OF   NURSING  ATTITUDES  -^OWARD 
COMPUTERS   lU   HEALTH  CARE 


PURPOSE   OF  STUDY 


Computer   teclmology  is  rapidly  becoming  a  part  of  health 
care,   and  one  of   the   primary  groups   to  be  affected   by  computer 
automation  is   aursing.     Many  opinions  have  been  expressed  in  the 
literature — some  authors   suggest   ways   to   facilitate  nursas' 
acceptance  of   this   innovation,   while   others  specul^'te   that  the 
"human  oriented"   profespion  will   not   accept   thtj   idea  of  computer 
technology.     Most   uf   these   points   of  view  have  not  been 
supported  by  empxrical   data.     The   primary  focus   of   this   study  is 
to  assess   the  attitudes  of   practicing   nurses,   nursing  faculty 
a?  ^   nurs.^ng   students   toward  the  use   of   computers   in   the  health 
care  setting. 


REVIEW  OF  LITERATURE 


Nursing  professionals   have  been  writing  about  computer 
technologv  since   the  early  sixties,   with  a  significant  number  of 
articJes  written  on  the  subject  beginning   in   the  mid-seventies. 
Even  today,   however,   nursing   journals  do  not   publish  a  great 
deal  on  the   subject  —  <:ome   journals  dedicate  only   two  articles 
per  year   to   the   topic   of  computers   in  nursing  and  health  care 
(Grobe^    1985).     The  majority  of   the   literature  deals   with  five 
irain  areas  of   computer  usage   in  relation   to  nursing  and  health 
care:      1)     client   data  gathering   functions,   2)  educational 
applications,    3)     adm i ni s t t a t i ve /manageme n c  uses,   4)  clinica] 
practice  applications,   and   5)     research  functions.      (See  the 
bibliography   for  citations   concerning  each  of   ihese  areas). 
These  are,   of   course,   important   topics   of   study;   however,  few 
riursing   research   studies   deal   with  questions   r'igarding  the 
potential   implications   for   users   of   automation  in  he.lth 
Ccire--the  human  factors. 


Schwartz   (1984)   identifies  human   factors,   which  are 
perceptual   and  attitudinal   in   nature^    that   can  be  categorized  as 
fo-lows:      1)     apprehension/confidence   level,    2)     perception  of 
usefulness   of   technology,   and   3)     user  motivation.  Throughout 
the   nursing   literature  may  be   found   "opinion  articles"  that 
discuss   these  human  factors   in  terms  of   how  nursing  should 
approach   ths   introduction  of   computer   technology   into  health 
care,   or   that   offer  predictions  of  how  nurses  will   respond  to 
the  computerization  process.     These   articles  approach  the 
subjerf-   from  an  experiential  basis  —  the  opinions  are  rarely 
based  upon  empirical  data.     The  folio ;»ing  examples  are  typical 
of  most   "human  factors"   literature   'n  nursing.     ^.Anderson,  1984; 
Zielstroff,    1976;   Tate,    1975;    Waterstradt,  1981): 

a)     Careful   planiiag   is  essential  when  implementing  change: 
ownership  of   the  computerization   plan  will   facilite  acceptance. 


t;      ;pen  lines   of   commupications  must  be  maintained. 


c)  A  sense  of  urgency  and  commitirent  must  be  conveyed  to 
facil  itate  automatior.  by  maintaining  a   forward  momentum* 

d)  Group  work  is  essential   in  developing  a  j^ense  of 
ownership  regarding   the  adoption  of  automation. 

e)  A  formalized   orientation  program  must  bs   planned  and 
offered   for  all   nursing   staff  members  and   for  new  employees. 

Another  area  of   tlie   literature   concentrates  on  more 
abstract   and   theoretical  aspects,   such  as  couflict  that  occurs 
with  change  of  any  kind  and  strategies   that  aid   in  copiug  with 
these   changes.     Tate   (  1975)   s-ites   three   types   of   conflict  that 
can  occur  with  computer  automation — those   that:      1)     stem  from 
differing  goals  and   incompatible   pe  r  ce  p  t  ions  /  va  lue  s  /  be  1  ie  f  *^  ,  2) 
reflect  struggles  regarding  the  allocation  of   resources   such  as 
funding,   equipment,   power,   status,   and   3)     relate   to  perceived 
threats   to  one's   identity  as  part  of  a  group.     Tate's  suggested 
strategies   for  coping  with  changes   related   to  computerization 
are  useful   for  both  the   individual   staff  nurse  and   the  nurse 
administrator.     The   recommended   strategy  includes   collecting  the 
facts,   understanding   the  nature  and   dynamics   of   the  system, 
developing  assertiveness   skills  and   strategies,   confronting  the 
issue,   compromising  and  negotiating   resolution,   and  finally, 
"refreezing" — dealing  with   relationships   that  have  been  strained 
in   the  process. 

Mixed   predictions  and   reviews  are   found   regarding  the 
responses   of  nurses   to  computer  automation.     Frank  (1964)  speaks 
of  depersonalization  and  other  dangers   that   the   " techno t ronic" 
age  can  bring,   while   reassuring   the   reader  that  nurses  need  not 
be   fearful   of  being   replaced  by  computers.     Another  author  deals 
with  "computer  cowardice"  among  nurses   and  offers  educational 
solutions   to  miminize   the  effect   (Grobe,    1984).     Two   of   the  few 
empirical  studies   on  nursing  attitudes   toward  computerizaton  in 
health  care   present  a  very  different   point  of  view.  Norwood, 
Hawkins  and   Gall   (1976)   found   that  94%  of   their  respondents 
indicated  a  favorable  view  regarding   the  use   of   computers  in 
health  care.     Krampf  and  Robinson  (1984)   reported   the  followi 
attitudes  of  nurses   toward  computers:     79.5Z   feel   that   they  will 
gain  satisfaction   from  learning   to  use  a  computer,   90.4%  believe 
that   if  nursing   informaton   is  automated  nursing   productivity  and 
effectiveness  will   be   increased,   and   87.7%  indicated  a 
willingness   to  attend   staff   development   programs  on  computers. 

A  review  of   the   literature   regarding  how  nurses  will 
respond   to  computerization  or  how  nursing   leaders  should 
introduce   the  computer  automation  process   in  health  care 
settings   shows  a  wealth   of   personal   opinions   and  personal 
experiences,   but   a  dearth  oJ  quantifiable  data.  Little 
empirical   information  is  available   that   corpares  perceptions  and 
attitudes   toward   computerization;      that  which  dees  exist 
evaluates   primarily  the   practicing  nurse  and  does   not  address 
the  attitudes   of  nursing  students  and  faculty.     One   primary  goal 
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of   the   present   study   is   to  assess   the  attitudes  and  perceptions 
of   practicing  nurses,    student   nurses,   and   nurse  educators  toward 
computerization  of   health  care   in  general,   and   its   impact   on  the 
profession  of   nursing   in   particular.     The   following  research 
question?  were  formulated: 

1)  What   is   the   perceived  value  of  computers  in 
health  care  ? 

2)  Whac   is   the   perceived  effect   of  computer 
automation  on   nursing  practice/ 

3)  What   are   nurses'   atcltudes   toward  learning 
about  computers? 

4)  What   factors   are   perceived  as   enhancing  or 
inhibiting   the   process  of  computerization 
in  health  care? 


DEFINITION  OF  TERMS 

Attitude — an   individual's   feeling,   position,  orientation, 
or  opinion   toward  a   to;;>ic,   subject  or  event. 

Nurse   3ducators — facuty  members   currently   teaching   in  a 
nursing   sducation   program   (all   faculty  must  be   licensed  and 
have  completed  masters   or  doctoral  degree  preparation). 

Nursing  s t ude n t s r s t  and  second  year  students  enrolled 
in   two  year  nursing  education  programs. 

Percept iun--an   individual's   thought,   understanding,  or 
cognition   relevant   to  a   topic,   subject   or  event. 

iracticing   uui ses--registered   nurses   (Jiploma,   A.D,,  B.S., 
and  M.S.   prepared)   employed   in  general  hospital  settings. 


METHODOLOGY 

Questionnaires   were   sent   to  nursing,   personnel  at  two 
general  hospitals,    \irsing  educators  at   th^-ee  associate  degree 
schools   of   nursing,   ;^nd   student  nurses  at   two  associate  degree 
nursing   programs.     Agencies   participating   in   the   study  did  not 
have  hospital   information   systems   or  computer  assisted 
instruction   programs   in   operation  at   that   time.  Each 
participant   was  asked   to   respond   to  a  series   of  twenty 
ouestion^.     Demographic   information   included  age,   sex,    level  of 
education,   previous   experience   in  health  car»    delivery,  and 
previous   use   of   computers   in   the  health   care  setting. 
Additional   questions   assessed   the   participants'   views  r^gaifing 
the  usefulness   of   the   computer  and   the   effect   it   may  have  on 
nursing  and  health  care.     Anonymity  was  maintained  throughout 
the   study--the   identities   of   individuals  who  participated  were 
not   revealed  and   only  group  data  were  analyzed.     The   sample  size 
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was   83  first   year  nursing  students,   84  second  year  nursing 
studentt*,    52  practicing  nurses,   and   26  nursing  faculty*  Ten 
percent   of   the   respondents  were  male;    this   reflects   the  national 
demographic   trend  of  male   representaton   in  the   profession.  Not 
all   participants   responded   r.o  all  of   the   questions;    for  this 
•reason,    the  actual   number  of   data  vary   from  question  to 
question.     The  questionnaire   response   rate  was  66%, 
Statistical  ar.alyses   were   performed  using  Chi   square,  cross 
tabulations   and  frequencies. 


RESULTS 

The   results   of   the   study  fall   into   four  general  categories. 
These  categories  are:      perceived  value   of   computers   in  health 
care,   perceived     effect   of   computers  on  nursing  practice, 
attitude   toward   learning  about  computers   in  health  care,  and 
perceived   factors   which   facilitate   or  hinder   the  implementation 
of  computers. 


A.      Value   of   Computers   in   Health  Care 

The   first   category  deals  with   some   basic   attitudes  that 
professional  and   pre-prof essional  nurses   have   toward  computers 
in   the   health  care   system.      Specific   questions   assess  previous 
experience  with  computers,   and   the   perceived   effect   of  this 
technology  on  health  care. 


Tcble    1.      QUESTION:      HAVE   YOU   HAD   PREVIOUS   P^XPERIENCE  WITH 
COMPUTERS    IN   A   HEALTH   CARE  FACILITY? 


Previous   experience  ) 

No  experience  Experience  TOTAL 

Students  70*1  29.9  100 

Practicing  64.2  35.8  100 

n  u  r    e  " 

Nursing  30.8  69.2  100 
faculty 


Chi-square  =»  15.2 
**   p   <  .0005 


9,'i 


The  data  indicate  that  most  of  the  respondents  have  not  had 
experience  with  computers  in  a  health  care  facility.  However, 
it  appears  that  nursing  faculty  have  had  this  background  as  part 
of  their  professional  experience.  Just  under  70%  of  the  nursing 
faculty  had  worked  with  computers  as  compared  to  approximately  a 
third  of   the   nonfaculty  personnel. 


Table   2.  QUESTION: 
AFFECr  HEALTH  CARE? 


DO  YOU  THINK  THAT  COMPUTERS  WILL 


Potenticl  effect  (%) 
Will  affect  No  affect  Total 


Students 


97.0 


3.0 


100 


Practicing 
nur  se  s 


94.3 


5.7 


]00 


Nur s  ing 
faculty 


100 


100 


Chi-square  =  1.87 
p  <  0.39 


The   response   to   this   question   is   an  overwhelming,  "Yes, 
computers  will  affect  healtli  care   in   the   future."     Few  of  the 
participants  disagree  with   this   concept.     There  is  no 
significant  difference   in  lesponses  among   the  members  of  the 
three  groups. 
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Table   3,     QUESTION:      IF  COMPUTER  TECHNOLOGY  DOES  AFFECT 
HEALTH  CARE,    DO   YOU  BELIEVE  THAT   ITS    INFLUENCE  WILL  BE  POSITIVE 
OR  NEGATIVE? 


Pos i t i ve /nega t i ve   influence  (%) 

Positive  Negative  Total 

First  year  ICO  0  100 

students 

Second  year  97.6  2,4  100 

students 

Practicing  94.1  5.9  100 

nurses 

Nursing  100  0  100 

faculty 


Chi-square  =  6.00 
p  <  .11 


Once   again ,  the 
computers   will  be  pos 
negative,   it   is  clear 
nursing   students  feel 
add   to  health  care. 


participant s  agree. 

itive .     While   a  few 
that   the  great  ma jo 
that   computers  have 


The   influence  of 
responses   we  re 
rity  of   nurses  and 
something   positive  to 


B.     Effect   of   Computers   on   Nursing  Practice 

The   next   category  of   questions   deals   with   the  general 
impact   of   computerization  on  nursing,   and   the   specific  areas  of 
nursing  which  would  be   affected   by   the   introduction  of  computer 
technology   into   the  health   care  setting. 
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Table   4.      QUESTION:      DO   YOU  THINK  THAT  COMPUTERS   COULD  HELP 
YOU   PERFORM  YOUR  NURSING  DUTIES   MORE  EFFECTIVELY? 


First  year 
st ude  nt  s 

Second  year 
students 

Pract  icing 
nur se  s 

Nur s  i  ng 
faculty 


Effectiveness  (%) 
More  effective         Less  effective 
93.7  6.3 


89.  0 


86.  5 


96.2 


11 


13.5 


3.9 


Total 

100 

100 
100 
100 


Chi-square 
p  <  .38 


=  3.11 


Members   of   eazh   group   strongly  agree   that   computers  would 
specifically  aid   narsing   personnel   in  performing   their  nursing 
duties.      This   perception   of   the   use   of   computers   indicates  that 
a  few  of   the   respondents   seem   to   believe   that   computers  will 
affect   other   components   of   health  care  more   positively   than  it 
will  nursing. 
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Table   5,        QUESTION:     WHICH  NURSING   SPECIALTY  DO  YOU  BELIEVE 
WOUL.D  BE  MOST   DIRECTLY  AFFECTED  3Y  THE    INTRODUCTION  OF  COMPUTER 
TECHNOLOGY   INTO   THE  HEALTH  C..RE  SYSTEM? 


Special ty 

Frequency  Percent 


ICU/CCU 

78 

34.  2 

Medical/surgical 

51 

22.4 

Emergency/ outpatient 

46 

20.  2 

Other  specialty 

23 

10.  1 

Community  health 

15 

6.6 

Rehabi 1 i t a t i on/ ex t e nde d  care 

1  2 

5.2 

Obstetrics/gyne oology 

2 

.9 

Psychiatric/mental  health 

1 

.4 

Fed  i  a  t  r  ic  s 

0 

0.0 

Table  6.  QUESTION:  WHICH  NURSING  SPECIALTY  DO  YOU  BELIEVE 
WOULD  BE  LEAST  DIRECTLY  AFFECTED  BY  THE  INTRODUCTION  OF  COMPUTER 
TECHNOLOGY   INTO   THE   HEALTH  CARE  SYSTEM? 


Spec  ial ty 

Frequency  Percent 


Psychiatric/mental  health 

53 

23.6 

Community  health 

48 

21.3 

Rehabilitation 

46 

20.4 

Emergency/outpatient 

26 

11.6 

Obstetrics /gynecology 

13 

8.0 

Other  specialty 

1  6 

7  .  1 

Fed  i  a  t  r  ic  s 

7 

3.  1 

ICU/CCU 

6 

2.7 

Medical/surgical 

5 

2.2 

The   specialty  which  nurses  believe  would  be  most  affected 
is   the   highly   technologically   oriented   ICU/CCU.  Conversely, 
nurses   believe   that   the   psychiatric/mental  health  special 
would  be   least  affected.     The   trends   displayed   in  tables   5  and  6 
suggest   that   nurses   think  specialties   such  as   ICU/CCU  and 
medical/surgical   nursing,   which  currently  use  a   large  amount  of 
technology,   will   continue   to  be  affected  by  new  technologies, 
and   that   the   less   technological  specialities   such  as  mental 
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health,   community  health,   and   rehabilitation  will  not  be 
affected  quice  as   strongly.     The  attitude   reflected   in  these 
responses   seems   to  be   that   those   specialities  currently  using 
technology  will   increasingly  be  expected   to  work  with  computers 
and   those   soecialities  not   currently   involved  will   not  be  as 
dramatically  affected. 


Table    7,        QUESTION:      WHICH  NURSING  ROLE   DO   YOU  BELIEVE 
WOULD  BE  MOST  AFFECTED  BY  THE   INTRODUCTION  OF  COMPUTER 
TECHNOLOGY   INTO   THE  HEALTH  CARE  SYSTEM*^ 


Role 


Frequency 

Percent 

Staff  nurse 

91 

38.  2 

Nurse  researcher 

56 

23.5 

Director  of  nursing/ 

supervisor 

23 

9.7 

Head  nurse 

23 

9.7 

Office  nurse 

17 

7  .  I 

Nurse  educator 

8 

3.4 

Nurse  practitioner 

7 

2.9 

Clinical  nurse  specialist 

7 

2.9 

Other  role 

6 

2.5 

Tabl^   8.        QUESTION:    WHICH  NURSING  ROLE   DO   YOU   BELIEVE  WOULD 
BE   LEAST  AFFECTED   BY   THE   INTRODUCTION  OF   COMPUTER  TECHNOLOGY 
INTO   THE   HEALTH  CARE  SYSTEM? 


Role 


Frequency  Percent 


Office   nurse  74  31.9 

Nurse  educator  38  16.4 

Staf:   nurse  37  16.0 
Director  of  nursing/ 

supervisor  27  11.6 

Nurse   practitioner  19  8.2 

Other   role  15  6.5 

Nurse   researcher  9  3.9 

Clinical  nurse  specialist  7  3*0 

Headnurse  6  2.6 
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These  data   indicate   that   the   two  nursing  roles  which  are 
perceived   as   being  most  affected  by   the  ccmputer  are   those  of 
the   staff   nurse  and   the  nurse   researcher.     When  asked  which 
nursing  roles  would  be   least   affected,    the   respondents  place 
office   nurses   and  nurse  educator     at   the   top  of   the  list. 

C.     Learning  About   Computers   i.        alth  Care 

The   third  category  of   responses  deals  with  perceptions  of 
the   survey  participants   regarding  computer  courses,   and  the 
respondents'   willingness   to   take   comp'Utar  courses   either  as  part 
of   formal   nursing   education  or  as  an   inservice  activity. 


Table    9.        QUESTION:      DO  YOU   THINK  THAT  TO   USE   A  COMPUTER 
EFFECTIVELY   YOU   NEED   A  STRONG  MATH  BACKGROUND? 


Math  background  (%) 
Necessary  Not   necessary  Total 


First  year 

students  18.3  81.7  100 


Second  year 

students  13.3  86.7  100 


Piacticing 

nurses  5.7  9^.2  100 


Nursing 

faculty  0.0  100.0  100 


Chi-square  =  8.83 
*   p   <  .03 


This   question   indicates   a  difference   in  attitude   among  the 
four  groups.     While   the   great  majority  of   participants   do  not 
believe   that   a   strong  math  background   is  necessary,    the  uc.ta 
indicate   that   the   student   responses   differ   s i gn i f i can *:  1  y  from 
those   of   the   nursing   faculty  and   practicing  nurses.  More 
students   hold   the   belief   that  math   is   important   in  ufli.ng 
computers   in  a  nursing  setting,   while  none  of   the   "  iculty  and 
only  a   few  practicing  nurses  agree. 
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Table    10.      QUESTION:      HOW  WOULD   YOU  FEEL  ABOUT  TAKING  A 
COURSE   IN  "COMPUTERS    IN  NURSING?'* 


Students       Practicing       Faculty  Total 
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■J  y  *  J 

54.7                   40-0  42-9 

Tomf or  table 

27  .7 

32.1                 48.0  37.6 

Neut  ral 

13.8 

5.7                   4.0  11.0 

Somewha  t 

Uncomf  or  *:able 

4.8 

3.                     4   0  4.5 

App  r ehe ns  i ve 

4.2 

ft                   An               A  1 

NSD  df=8 

Table    11.  QUESTION: 
(USE   OF   COMPUTERS    IN  HEALTH 
STUDENTS? 

SHOULD 
CARE) 

A   COURSE    IN   COMPUTER  LITERACY 
BE   REQUIRED   FOR  NURSING 

NO 

YES 

Students 

47.9 

52.  1 

Prct^ticing 
Nur  se  s 

24.5 

75.5 

Faculty 

38.  5 

61.5 

**   p   <    .01  df=2 


Table    12*      QUESTION:      SHOULD  A  COURSE   IN  COMPUTER  LITERACY 
BE  OFFERED  AS   AN   ELECTIVE   FOR  NURSING  STUDENTS? 


NO 

YES 

St  ude  n  C  s 

M  .0 

89.0 

Pract Ic  ing 
Nurses 

32  .  6 

67.4 

Faculty 

16  .  7 

83.3 

TOTAL 

15.8 

84.  2 

**   p   <    .01  df=2 


Table    13*      QUESTION:      IF   A  COLLEGE  COURSE   OR  CONTINUING 
EDUCATION  OFFERING    IN   COMPUTER  LITERACY  V'ERE   AVAILABLE,  WOULD 
YOU   ENROLL    IN  IT? 


NO  YES 

Students  11.7  88.3 

Practicing 

Nurses  9.6  90.4 

Faculty  12.5  87.5 

TOTAL  AVERAGE  11.?  88 .  7 


NSD       di-  =  2 


Tables    10  -   13   present   some   interesting   data.     Most  nurses 
are   not   afraid   to   enroll   in  a   course   in  computer  literacy.  In 
fact,   80.5%  of   the   respondents   indicate   that   they  would  feel 
comfortable  or  even  confident  about   taking  such  a   course;  only 
44,1%  express  a   feeling   of   apprehension.       When  astced   if   a  course 
in  computer  literacy   should  be   required   for  all  nursing 
students,   practicing   nurses,   nurse  educators,   and  students 
nurses   disagree   significantly.      The   students   are  about  evenly 
divided   in   their   opinions;   however,    three   of   every  four 
practicing   nurses   believe   that   a  course   should  be  required. 
Nurse  educators   suppOi"t   the   idea  at  a  ratio  of   two   to  one. 
Table    12  presents   a   seeminp^ly  contradictory  situation.  While 
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students  and   faculty  groups   support   the   idea  of  having  a 
computer  course  as  an  elective,    trie   response   rate  of  the 
practicing  nurses   falls   from  75.5%   (required)    to  only  67.4% 
(elective).     Apparently,   practicing  nurses   feel   that  knowledge 
of   the  use  of   computers   in  health  care   is   sufficiently  important 
that  a  computer  literacy  course   should  not   be  an  optional 
matter,   but   rather   that  all   new  nurses   should  have  a  background 
in  the  subject.     Table   13  indicates   that  all   three  groups  of 
respondents  would  be   interested  in  enrolling   in  a  college  or 
continuing  educatioa  course   in  computer  literacy,  Appoximately 
89%  of   the  sample   say   that   they  will  enroll   if  given  the 
oppor tuni  ty , 


D,     Factors   Affecting   Implementation  of  Computers 

The   final   category  of   items   deals  with  factors  which 
facilitate  or  inhibit   the   introduction  of   computer  technology 
into   the  health  care  setting. 


Table  14,  QUEiTION:  WHAT  DO  YOU  BELIEVE  WOULD  BE  THE 
MAJOR  FACTOR  IN  BLOCKING  THE  IMPLEMENTATION  OF  COMPUTERS  IN 
HEALTH  CARE? 


Fac  t or 


Frequency  Percent 


Financial  considerations  137  56,2 

Nursing  staff  attitudes  48  19.7 

Administrationattitudes  33  13,5 

Medical   staff   attitudes  20  8,2 

Other  factor  6  2.5 


Table    15,      QUESTION    :      WHAT   DO   YOU   BELIEvfi  WOUuD   BE  THE 
MAJOR  FACTOR   IN   FACILITATING     THE    IMPLEMENTATION  OF  COMPUTERS 
HEALTH  CARE? 


Factor 


Frequency  Percent 


Administration  attitudes  110  46,0 

Financial   considerations  57  23,9 

Nursing  staff   attitudes  36  15,0 

Medical   staff   attitudes  27  11,3 

Other   factors  9  3,8 
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Nurses   identify   the  major  obstacle   to   the   implementation  of 
computers   in  health  care  as   the   lack  of  money.     This   factor  is 
followed  by   the  attitudes  of  nursing  staff.     They  also  believe 
the  major  factor  which  could   facilitate   the   implementation  of 
computer   technology   to  be  a   positive  administrative  attitude, 
and   to  a   lesser  degree  an  adequate   supply  of  money. 


DISCUSSION  AND  IMPLICATIONS 

The   results  of   this   study  are  categorized   into   four  general 
groups.     The   first  of   these  categories   is   the   perceived   value  of 
computers   in   the  health  care   system.     Although   few  of  the 
respondents   to   the  questionnaire  have  had   previous  experience 
with  computers,    they   believe   that   this   technology  will   have  a 
profound  effect   on  health  care  and   that   this  effect   will  enhance 
the   quality  of   health  care.     The   second  category  examines  how 
respondents   perceive   the  effect   of   computerization  on  nursing 
practice.     The   opinion  of   the  nurses   is   that   they  expect  the 
more   technologically  oriented  specialities   to  be  most  affected. 
Specialities   such  as    ICU/CCU,   medical   surgical,   and  emergency 
outpatient  nursing  are  expected   to  be  most  dramatically  affected 
while   the   r r ad i t i cna 1 1 y  "human  oriented"   specialities  like 
psychiatric/mental   he£;lth  nursing  and   community  health  nursing 
will  be  least  affecced.     Tv/o  nursing  roles  are  expected   to  be 
most  affected  by  computers.     Staff   nurses  and  nurse  researchers 
are  at   the   top  of   the   "most  affected"   list.     This   result   ib  not 
particularly  surprising   since   these   two  roles  are  now  using 
computers   in  a  number  of   hospital  and   university  settings. 
However,    the   three   roles  believed   to  be   least  aftecteJ  are 
office  nurse,   nurse  educator,   and  once  again  staff   nurse.  The 
fact   that   the   role  of   staff   nurse   is  mentioned   toward   the   top  of 
each  list   indicates   that   some  disagreement   exists   regarding  the 
full   impact   on   this   particular  nursing   role.     The   third  category 
of  responses  deals  with   the  nurses'   attitudes   toward  learning 
more  about   computers.     Apparently   the  majority  nurses  do  not 
suffer   from  a  pronounced   sense  of   cyberphobia.     Most   of  the 
respondents   indicate   that   they  are  not   afraid  of    this  emerging 
technology,   and  express   a  strong  desire   for  learning  more  about 
the   subject;    they  also   strongly  encourage   nursing  education  to 
include    i  course  on  computer   literacy   in  the  nursing  curriculum. 
These  data  suggest   that   leaders   in   the   process  of  computer 
automation  need   not   spend  as  much   time  as   previously   thought  in 
"preparing  nursing   personnel   to  accept   the  computer."  Rather 
time   should   be  devoted   to  designing  courses  and  implementing 
plans   to   effectively   teach   the   nursing   staff   to   use  computers. 
The   final   category  of   responses  deal  with   those   factors  which 
nurses   believe  will  enhance   or  hinder   che   implementation  of 
computers.     As  might   be   expected,   financial  considerations  is 
identified  as   the  number  one  factor   to  block   the  implementation 
of  computers.     Money  is   always  a  major   consideration  when 
introducing  costly   innovations.     When  asked  which  factors  would 
most   facilitate   the   implementation  of   computers,   nurses  indicate 
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chat  a   posiuive  admi n i r C r a C i ve  attitude   is  most   important.  This 
implies   that   strong  central   administration  support  of 
computerization  can  have  a   significant,   positive   influence  in 
the  automation   of   a  health  care  unit. 

Replication   of   this   study   is   recommended   to  vf.lidate  the 
findings   recorded   here.     Further   study  could  also   include  data 
from  respondents   grouped  according   to   formal   nursing  preparation 
(e.g.   diploma,   associate  degree,   baccalaureate,   masters,  and 
doctorate),    to  determine  how  formal   education   influences  nurses' 
perceptions   of   computer  automation   in  health  care.  An 
examination   of   attitudes   and   perceptions   of   various   age  groups 
regarding   computer  automation  might   also  yield   interesting  and 
useful   results.      Reviewing  data   from  these  varied  respondents 
could  guide   the   nurse   educator  or   nurse  administrator  who  is 
planning   for   computerization  and   is   considering   the  needs   of  the 
professionals   or   pre-prof essionals  who  will   be   affected   by  this 
process.      Data   comparing   p r e-compu t e r i za t ion  and 
post-computerization   perceptions   and  attitudes   of   nurses  could 
be  useful    in   evaluating   the   impact  of   changes  undergone,   and  the 
effectiveness   of   plans   and   strategies   implemented.      Such  results 
may  assist   nurse  administrators  and  educators  when  planning  for 
the   future   technological   advancements   that   are  inevitable. 


CCNCLUS ION 

Throughout   the   literature  may  be   found  references 
discussing  how  nurses   should   approach   the   introduction  of 
computer   technology   into   the   health  care   setting,   and  how  nurses 
will   respond   to  computer  automation.      Unfortunately,    few  hard 
data  are   available   to   support    these  claims.      This   study  provides 
an  empirical   background.     Among   the   findings   of   this   study  are 
the   following:      nurses   are   accepting,   not   opposing  computer 
technology  in   the   health  care   setting;    nurses   perceive  the 
influence   of   computers   on   nursing  and  health  care   to  be 
positive;    nursing  curricula   should  provide  educational 
preparation   in   computer   technology;   continuing  education 
offerings   will   be  we 1 1 -r ec e i ved  by  nursing;   and   nurses  identify 
a   .-'trongly   positive  orientation  by  admi  n  s  1 1  a  t  o  r  s  as  facilitating 
the   computerization   process   in  health  ca^'e.      Finally,  these 
empirical   data   indicate  a   willingness   among   nurses   to   enter  the 
information  aga   with  a   progressive,   positive  orient .ition  and 
with  preparedness. 
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RESEARCH  ON  TELETRAINING: 
STUDENT  ACCEPTANCE,  LEARNING  EFFECTIVENESS 
AND  COST  BENEFITS  IN  THE  CORPORATE  ENVIRONtCNT 

INTRODUCTION 

Previous  research  on  teletralnlng  has  Indicated  that  teletralnlng  Is  a  viable 
alternative  delivery  nedlua  for  short  duration  prograos.    Since  1981,  AT&T  has 
studied  teletralnlng  effectiveness  for  short  continuing  education  prograas  and 
for  nultl-day  courses.    This  paper  highlights  the  1984  research  results  and 
the  benefits  associated  with  u^lng  teletralnlng  to  deliver  training  to  a 
nationwide  audience. 

BACEGROOMD 

The  AT&T  CoBBunlcatlons  National  Teletralnlng  Network  was  established  to  meet 
the  needs  of  professional  sales  personnel  located  throughout  the  United 
States.    Because  of  high  costs  associated  with  travel  and  travel  time  and  the 
need  to  keep  pro^^^slonal  sales  r^oplt        o-date  on  the  latest  service  Infor- 
mation and  technological  development.       .  National  Teletralnlng  Network  was 
impieikented. 
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In  1981,  AT&T  Couunlcatlons  began  to  offer  professional  sales  courses  to 
field  locations  via  teletralnlng.    These  courses  had  duration  which  ranged 
froi  2  days  to  2  weeks.    In  October  of  19839  the  Sales  and  Harketlng  Education 
Division  began  to  offer  weekly  one  hour  Infornatlon  updates  to  the  field  sales 
personnel  throughout  the  United  States.    The  program  developed  for  teletraln- 
ing  delivery  were  topics  that  field  sales  managers  had  Identified  as  high 
Interest  topics  which  were  required  to  keep  current  In  a  coapetltlve  telecon- 
fflunlcatlons  envlrcnnent. 

In  October  of  1983,  weekly  programs  were  delivered  to  five  cities,  one  from 
each  AT&T  Couunlcatlons  region.    In  Noveaber  of  1983»  five  additional  sites 
were  added  because  of  requests  froa  field  nanagers  to  Include  their  cities  on 
the  National  Teletralnlng  Network.    Since  then  the  network  grew  steadily  to  a 
network  of  over  135  locations  at  the  end  of  1984. 

The  network  today  delivers  weekly  one  hour  prograos  and  regularly  scheduled 
teletralned  courses  which  are  periodically  evaluated  using  a  reaction  level 
evaluation  survey,  course  debrleflngs  and  cognitive  pre  and  post  tests.  The 
nuaber  of  programs  and  courses  offered  and  the  number  of  total  participants 
who  have  attenaed  National  Teletralnlng  Network  programs  grew  steadily  since 
the  Initiation  of  the  project  to  over  21,000  by  the  end  of  1984.  Research 
studies  were  conducted  to  track  effectiveness  and  trial  new  delivery  tech- 
niques. 
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TELETRAINED  RESEARCH 


The  Sales  and  Marketing  Education  organization  haa  contlni^lly  monitored  the 
lapact  of  teletrainlng  on  learning,  on  student  acceptance  of  couraea  ^nd 
Inatructora,  and  on  atudent  wlillngnefs  to  take  additional  teletralned  pro- 
graiia,    Thla  aectlon  of  the  article  revlewa  the  reaearch  conducted  during 
1984, 

Student  Learning 

Previous  reaearch  conducted  by  Salea  and  Marketing  Education  haa  ahown  there 
la  no  algnlflcant  difference  between  the  amount  studenta  learn  In  classes  that 
are  teletralned  and  the  amount  learned  In  face-to-face  classes.    To  continue 
with  our  ongoing  research,  comparative  studies  of  test  results  are  periodical- 
ly conducted.    The  most  recent  study  compared  the  test  scores  for  students 
attending  telet.'^alned  and  face-to-face  classes  of  the  Telemarketing  I  course. 
The  results  for  two  classes  are  presented  In  Figure  1,    The  teletralned  group 
performed  slightly  higher  on  the  pre^test,  but  the  difference  between  the  two 
groups  was  not  significant  at  the  ,05  level  (t::1,73f  df=20}.    On  the  post- 
test,  the  teletralned  group's  performance  was  significantly  higher  than  the 
face-to-face  group  (t=6.24,  df=20). 
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student  Acceptance  of  Courses  and  Instructors 


All  students  attending  courses  at  the  AT&T  Couunlcatlons  training  centers 
coaplete  a  student  reaction  survey  at  the  end  of  each  class.    The  survey  has 
two  categories:    course  relevance  and  design,  and  qt  iity  of  Instruction.  The 
last  Itea  In  each  category  Is  used  as  a  general  Index  of  student  satisfaction. 
The  Iteas  are:    '^Overall,  I  feel  the  course  was  effective."   and  '^Overall  I 
feel  the  Instructor  was  effective. These  two  Iteas  were  used  to  conpare 
student  acceptance  of  the  face-to-face  and  teletralned  courses. 

During  1984,  courses  In  the  sales  training  currlculua  were  converted  to  tele- 
trained  delivery.    As  tk.e  transition  was  belnn  nade  to  a  teletralned  delivery 
mode,  the  courses  continued  to  be  taught  face-to-face.    Modifications  were 
nade  in  .  e  design  of  Ihe  courses  to  adapt  to  the  vedlun  of  teletralnlng; 
however,  the  course  objectives  and  the  Instructors  were  the  saae  for  both  the 
face-to- face  and  teletralned  versions  of  the  courses.    During  the  study 
period,  a  total  329  students  attended  45  face-to-face  classes,  and  590 
students  attended  32  teletralned  classes. 

Significance  tests  for  large-sajnple  means  were  used  to  compare  the  data  for 
all  face-to-face  classes  with  the  teletralned  scores  for  the  second  half  of 
1984.    The  teletralned  classes  from  July  through  December  were  used  because 
tue  courses  were  progressively  being  converted  to  teletralned  delivery  during 
the  first  half  of  the  year.    The  results  of  these  analyses  are  shown  In 
Figures  2  and  3*    No  significant  differences  at  the  .05  level  of  significance 
were  found  between  the  face-to-face  and  the  teletralned  classes  on  either  the 
course  relevance  and  design  or  the  quality  of  instruction  categories.  This 


113 


research  supports  the  conclusion  that  students  do  not  perceive  a  difference  In 
effectiveness  between  courses  delivered  In  a  teletralned  delivery  mode  and 
those  delivered  In  acre  v      Monal  face-to-face  classes. 

Acceptance  of  National  Teletralnlng  Network  Prograas 

A  short  questionnaire  was  used  to  evaluate  the  effectiveness  of  the  one-hour 
teletralnlng  programs  offered  to  the  sales  force  via  the  National  Teletralnlng 
Network.    The  most  Important  Item  on  the  questionnaire  was:       woulu  partici- 
pate In  future  teletralnlng  courses •**   This  Item  was  measured  on  a  five-point 
scale  and  was  used  as  an  Indicator  of  student  acceptance  of  these  programs. 
Figure  4  shows  the  results  on  this  item  for  the  first  three  quarters  of  NTN 
programming.    The  percent  agreement  with  the  statement »  as  indicated  by  a 
rating  of  4  or  5»  was  88. in  the  fourth  quarter  of  1983»  and  rose  to  9U6% 
in  the  second  quarter  of  1984.    Similarlyy  the  percent  unwilling  to  partici- 
pate in  future  programs  declined  from  ^.5%  to  .8%  respectively.    Since  the 
results  were  uniformly  positive  across  the  5»530  students  who  participatsd  in 
the  programs »  the  use  of  the  form  was  discontinued  in  the  third  quarter  of 
1984  to  reduce  administrative  costs. 

Student  acceptance  of  the  ona-hour  teletralned  programs  began  high  and 
Increased  with  time*    Today,  these  short  programs  are  an  integral  part  of  Itie 
training  delivery  system.    The  teletralnlng  seminars  are  a  primary  vehicle  for 
introducing  new  applications  and  for  keeping  the  field  sales  people  up-to-date 
on  Important  Issues  and  services. 
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The  research  done  at  Sales  and  Marketing  Education  during  1984  focused  on 
demonstrating  that  teletralnlng  is  an  effective  training  ■edium  as  neasured  by 
student  learning  and  acceptance.    The  results  of  the  studies  presented  here 
strongly  support  the  conclusion  that  teletralnlng  Is  a  viable  Instructional 
delivery  aode. 

OOST  BENEFITS  OP  TQ.ETRAIMING 

The  National  Teletralnlng  Network  produced  slgnlfldant  cost  benefits  for  AT&T 
Coaiunlcatlons  In  1984.    Major  savings  were  realized  for  both  the  nultlple-day 
courses  and  the  one-hour  sealnar  programs  delivered  via  the  NTN.    The  savings 
resulted  from  travel  costs  and  productivity-related  costs  that  were  avoided  by 
using  the  teletralnlng  medium.    The  Information  presented  here  substantiates 
the  fact  that  teletralnlng  Is  a  cost-effectlva  alternative  to  fac6-to-face 
delivery  of  training. 

Savings  from  Telecralned  Courses 

In  computing  the  cost  benefits  for  the  courses  delivered  via  teletralnlng,  the 
assumption  was  made  that  students  would  have  had  to  travel  to  Sales  and  Mar- 
keting Education  In  Cincinnati  to  received  this  training  If  teletralnlng  were 
not  an  alternative.    During  1984,  590  students  attended  teletralned  sessions 
of  courses  In  the  sales  training  curriculum.    An  average  round-trip  airfare  of 
$400  and  a  per  diem  of  $90  per  day  for  lodging  and  dally  expenses  resulted  In 
a  total  cost  avoidance  per  student  of  $670  per  course.    The  average  course 
length  was  2.6  days.    The  total  savings  for  590  students  was  $395 t 300. 
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The  cost  avoidance  froa  not  traveling  Is  offset  somewhat  by  the  line  and 
bridge  charges  associated  with  teletralnlng.    A  typical  teletralned  course  at 
Sales  and  Marketing  Education  had  one  *^hoae  site**  and  two  reaote  sites.  This 
configuration  Incurred  charges  for  six  lines  (one  audio  and  one  audlographlc 
for  each  location),  and  six  ports  on  the  bridge  (two  for  each  location). 
Bridging  costs  were  based  on  the  AT&T  Coaaunlcatlon's  ALLIANCE*  Teleconference 
Ing  Services.    Equlpaent  and  other  capital  Investaents  were  not  considered  in 
these  calculations  since  existing  equlpaent  was  used;  only  operating  expenses 
were  Included.   Using  these  assuaptlons,  the  total  network  charges  for  the  57 
teletralned  sessions  was  $1979448.    Subtracting  these  network  tele training 
charges  froa  the  cost  avoidance  figure  produced  a  net  savings  of  $197f852,  or 
$335  per  student. 

Travel  cost  avoidance  was  only  part  of  the  actual  savings  realized  froa  tele- 
training.    Eaployee  productli/ity  savings  needed  to  be  factored  Into  the  coapu- 
tatlons;  that  is,  the  reeaployaent  of  non-productive  tlae  spend  traveling, 
waiting  Ir  airports,  and  catching  up  once  back  at  the  hoae  location.  Assuulng 
the  average  non-productive  tlae  was  six  hours  per  studen*.,  then  the  total 
lost-tiae  expense  for  590  students  was  $84,960,  or  $144  per  student.  Adding 
this  savings  to  the  earlier  travel  cost  figure  of  $335  per  student  produced  a 
total  net  cost  avoidance  of  $479  per  student. 

This  data  supports  the  assertion  that  teletraining  is  clearly  a  cost-effective 
way  to  deliver  courses.    The  benefits  included  both  direct  travel  e'ipense 
avoidance,  and  increased  productivity  resulting  froa  reduced  no  productive 
tlae. 


*A  service  lark  of  AT&T. 
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StvinM  from  PrograM 

Slallar  calculations  iitrt  parforatd  to  dtteralne  th«  cost  avoidance  for  tha 
profraM  prtaantad  vU  ttaaNatiiork.   Tha  following  two  assuaptlona  wara  aada  In 
doing  thaaa  calculations.   First,  students  froa  tha  130  flald  locations  would 
not  travel  to  the  Sales  and  Marketing  Education  Center  In  Cincinnati  to  parti- 
cipate lit  a  60-alnute  training  session;  therefore,  each  presenter  would  have 
to  travel  to  approxlaately  25  aajor  sites  t    deliver  the  training.  Second, 
students  would  utilize  ground  transportation  froa  local  or  reaote  locations  to 
attend  a  training  session  in  one  of  the  25  locations. 

If  each  presenter'  had  traveled  to  25  locations  costs  incurred  would  have  been 
$90  for  local  expenses  and  $400  for  airfare;  the  travel  cost  for  each  presen- 
ter would  have  been  $12,250.    For  the  44  prograas  presented  in  1984,  the  total 
cost  avoided  was  $539»000. 

The  cost  benefit  analysis  for  the  seainar  prograas  also  accounts  for  the  costs 
associated  with  the  operation  of  the  Rational  Teletrainlng  Network.    The  cost 
of  the  long  distance  calls  placed  to  Cincinnati  by  each  of  the  roaote  loca- 
tions was  $83,028.    These  prograas  did  not  use  any  interactive  graphic 
devices;  therefore,  only  one  telephone  circuit  was  required  for  each  reaote 
location.   Since  a  aeet-ae  preaises  bridge  lor a ted  at  Sales  and  Marketing 
Education  was  used,  no  additional  bridging  charges  were  incurred.  The 
expenses  Incurred  for  the  reproduction  of  visuals  used  for  the  progress  during 
1984  was  $38,754.   The  toUl  cost  avoidance  for  the  1984  National  Teletrainlng 
Network  prograas  was  $417,218,  a  net  savings  of  $9,482  per  prograa. 
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The  cost-benefit  calculations  Indicate  thiat  the  National  Teletralning  Network 
Is  a  cost  effective  aethod  for  providing  update  training  for  AT&T  Connunica- 
tlons.    Benefits  of  the  NT^  in  addition  tf?  cost-effectivc^ness  include:  the 
ability  cf  this  aediua  to  reach  reaoce,  low  density  locations  which  are  too 
difficult  and  tlae  consuaing  to  reach  through  conventional  travel  arrange- 
■ents;  the  ability  to  &dd  Multiple  1^         s  to  a  training  session  when 
needed;  the  fleiiibility  to  increase  the  number  of  students  who  can  be  reached 
at  one  tiae;  the  ability  to  quickly  dlsseainate  information  to  an  entire  sales 
force;  and  the  ability  to  share  United  instructor  resources.    Without  the 
NTN,  auch  of  the  current  update  training  would  not  be  attempted  due  to  various 
constraints.    Perhaps  the  chief  benefit  of  the  National  Teletraining  Network's 
prograas  is  that  it  provides  training  to  field  sales  people,  where  they  need 
it  and  when  they  need  it  to  remain  current  in  a  competitive  environment* 
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The  National  Teletraining  Network  has  had  a  positive  impact  on  the  field  sales 
force  within  AT&T  Communications  in  three  major  areas.    First,  sales  profes- 
sionals have  had  an  opportunity  to  keep  current  and  to  increase  their  know- 
ledge base  of  products  and  services  in  a  very  timely  manner.    Studies  conduct- 
ed within  AT&T  Communications  have  shown  that  teletraining  Is  a  viable  means 
of  learning  technical  information  and  sales  skills.    Second,  student  accep- 
tance of  the  National  Teletraining  Network's  programs  and  the  teletrained 
courses  has  been  outstanding.    Students  indicate  that  teletraining  is  a  viable 
medium  for  delivering  content  which  addresses  sales  akills  and  technical 
information.    Third,  the  National  Teletraining  Network's  w  jkly  programs  and 
teletrained  courses  have  been  proven  as  very  cost-effective  alternatives  to 
traditional  delivery  channels  for  professional  sales  and  marketing  education. 
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STUDENT  ACCEPTANCE  OF  COURSES 
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Abstract 

With  the  advent  of  basic  skills  curricula  throughout  the  United 
States,  many  educators  have  become  Increasingly  concerned  with  an 
apparent  lack  of  emphasis  on  higher-level  thinking  skills, 
specifically,  problem-solving  skills, 

To  address  this  concern,  many  school  districts  and  Individual 
teachers  have  adopted  the  use  of  the  LOGO  programming  language  to 
teach  problem-solving  skills.  The  many  assertions  regarding  the 
efficacy  of  LOGO  In  Improving  learner  achievement,  attitude,  and 
problem-solving  skills  made  by  the  proponents  of  LOGO  have  made 
LOGO  seem  Ideally  suited  for  classroom  application.  Unfortunately, 
many  of  these  assertions  have  yet  to  be  tested  empirically. 

In  this  study,  the  effects  of  LOGO  use  were  compared  with  a 
program  that  provides  instruction  in  problem-solving  strategies,  as 
well  as  with  a  control  group,  using  six  dependent  measures,  two  on 
each  of  the  following  constructs:  achievement,  attitude,  and 
problem-solving  skills. 

The  results  of  the  study  indicate  that  neither  LOGO  nor  the 
Problem-Solving  t^^eatments  produced  significant  improvement  in 
basic  skills  proficiency  or  general  attitudes.  However,  both  LOGO 
a-'id  the  Problem-Solving  group  were  successful  in  improving  learner 
attitudes  related  to  mathematics. 
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In  addition,  the  Problem-Solving  group  scored  significantly 
higher  on  both  measures  of  prob.ym-solving  skills  than  did  tne  LOGO 
group,  demonstrating  that  the  benefltb  of  LOGO  may  net  transfer 
beyond  the  LOGO  environment. 
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':ompar1son  of  the  Effects  3f  LOGO  Use  and 
Teacher-Directed  Problem-Solving  Instruction  on  the 
Problem-Solving  Skills,  Achievement, 
and  Attitudes  of  Low,  Average,  and  High  Achieving 
Junior  High  School  Learners 

There  !s  considerable  evidence  to  suggest  that 
computer-assisted  instruction  (CAD  Is  a  highly  effective  mode  of 
delivery  for  Instruction  In  a  wide  variety  of  Instructional  settings 
(Kullk,  1983). 

Yet,  Papert  (1980),  the  creator  of  the  LOGO  programming 
language  and  author  of  the  controversial  text  Mindstorms.  argues  that 
CAI  is  not  an  appropriate  use  of  the  microcomputer.  Papert  aryues 
that  CAI  does  not  allow  the  learner  to  control  the  learning,  so  the 
learning  content  becomes  separated  from  the  child's  reality,  and 
hence,  insignificant. 

Papert  believes  that  LOGO'S  turtle  geometry  is  an  ideal 
vehicle  for  teaching  problem-solving  skills,  It  Is  Papert's  contention 
that  children  are  able  to  "relate  to  the  turtle,"  and  that  learning 
becomes  more  concrete  and  hence,  easier  and  more  relevant.  Because 
the  learning  Is  more  relevant,  Papert  and  other  proponents  of  LOGO 
(Lawler,  1980;  Watt,  1982)  believe  that  LOGO  use  l^^ds  to  improved 
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learner  attitudes.  In  addition,  because  the  learner  Is  able  to 
articulate  his/her  thinking,  they  assert  that  LOGO  has  meta-cognltlve 
benefits  that  enable  the  learners  to  improve  their  performance  with 
basic  skills  and  transfer  newly  acquired  problem-solving  skills  to 
new  learning  situations. 

On  the  other  hand,  other  authors  have  noted  what  they  feel  Is 
a  lack  of  applicability  of  the  LOGO  language  In  the  framework  of  the 
traditional  public  school  curriculum  (Steffln,  1983). 

Although  It  has  been  used  and  tested  extensively  at  the 
Artificial  Intelligence  Laboratory  of  the  Massachusetts  Institute  of 
Technology  since  the  late  1960s,  LOGO  Is  relatively  new  In  the  public 
school  system,  appearing  in  microcomputer  form  around  1980. 
Because  of  this  lat  .tart,  little  research  has  been  conducted  on  the 
efficacy  of  the  LOGO  language.  Much  of  the  writings  concerning  LOGO 
to  date  are  very  "soft"  In  nature,  typically  describing  an  author's 
experlP'  e  In  integrating  LOGO  into  his/her  classroom. 

"Jntll  recently,  the  only  empirical  data  available  on  LOGO  had 
come  only  from  the  M.I.T.  researchers  themselves.  Although  these 
studies  are  objective  in  nature,  many  serious  questions  as  to  their 
external  validity  exist,  especially  considering  much  of  this  research 
has  been  conducted  on  large,  main  frame  computers,  rather  than  the 
microcomputers  In  use  In  the  schools.  Hence,  to  date,  many  of  the 
propositions  surrounding  the  use  of  LOGO  and  Its  benefits  are 
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virtually  untested. 

Clearly,  many  questions  concerning  the  efficacy  of  LOGO 
remain  unanswered  and  more  research  Is  required.  This  study 
compared  he  effects  of  LOGO  use  with  teacher-directed 
problem-solving  Instruction  and  conventional  mathematics 
instruction  on  the  problem-solving  ability,  basic  skills  achievement, 
and  attitudes  of  junior  hiyh  level  learners. 

Methods 

Subjects 

The  subjects  chosen  for  this  study  were  97  seventh  grade 
learners,  selected  from  five  sections  of  a  seventh  grade  mathematics 
course.  Few  of  the  learners  in  this  sample  had  previous  experience 
with  LOGO  and  none  of  the  learners  had  been  exposed  to  the 
problem-solving  strategies  employed  in  the  problem-solving 
treatment. 

There  was  an  approximately  equal  distribution  of  males  and 
females  in  the  group.  The  sample  was  composed  primarily  of  Anglo 
students  (n  =  85)  with  only  s  small  amount  of  minority  students  (n  = 
12). 

Materials 

Three  instructional  treatments  were  employed:  a  problem- 
solving  strategies  instructional  treatment,  a  structured  LOGO 
treatment,  and  a  control. 

o  126 
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Problem-Solving.  This  treatment  consisted  of  approximately 
20  h')urs  of  Instruction  In  problem-solving  strategies.  The  lessons  In 
this  treatment  consisted  of  self-contained,  print-based  worksheets, 
designed  to  function  entirely  as  stand-alone  Instruction.  The  learners 
were  given  the  appropriate  worksheets  and  directed  to  work 
Independently. 

The  lessons  of  this  treatment  focused  on  six  problem-solving 
strategies:  "Guess  and  Check,"  "Make  a  Table,"  "Patterns,"  "Make  a 
Model,"  "Elimination,"  and  "Simplify."  Materials  for  all  of  the  six 
strat  ?gl8S  were  adapteo  from  Teaching  Problem-Solving  Skills  (Dolan 
&  Williamson,  1983). 

LOGO.  In  this  treatment,  the  learners  were  provided  with 
approximately  20  hours  of  computer  time  In  which  to  explore  the 
turtle  graphics  capabilities  of  the  Terrapin  LOGO  language  on  the 
Apple  II  microcomputer  system.  Each  learner  was  provided  with  a 
lesson  which  contained  a  list  of  new  commands  and  exercises  which 
guided  exploration  of  these  commands.  Each  learner  worked 
Independently  to  complete  the  lesson.  Each  lesson  also  contained  a 
difficult,  culminating  activity  on  wnlch  the  learner  focused  after 
completion  of  the  preliminary  activities  of  the  lesson. 

Prior  to  the  beginning  of  the  study,  all  teachers  Involved  were 
given  a  briefing  on  the  type  of  Intervention  that  should  occur  so  that 
the  types  of  suggestions  given  to  the  learners  would  be  consistent 
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across  ail  groups. 

Control.  Learners  In  this  group  were  given  additional  time  for 
completing  any  school  assignments  and/or  recreational  reading. 
Dependent  Measures 

In  addition  to  the  three  treatments  described,  the  learners 
were  assessed  on  their  achiavement,  attitudes,  and  higher-level 
thinking  skills. 

Achievement  Measures.  There  were  two  measures  of 
achievement  used  in  this  study.  The  first  of  these  measures  was  the 
district  administered  Program  Criterion  Reference  Test  (PCRT).  This 
test  is  a  measure  of  the  student's  mastery  of  the  grade  level 
objectives,  The  test  contained  80  multiple  choice  Items,  four  for 
each  of  the  20  objectives.  Using  data  obtained  from  this  study 
yielded  a  split-half  reliability  coefficient  of  0.78. 

The  second  achievement  measure  used  In  this  study  was 
mathenatics  subtests  of  the  Comprehensive  Test  of  Basic  Skills.  The 
split-half  reliability  coefficient  for  the  combined  scales  was  found 
to  be  0.90,  using  data  from  this  study. 

Attitude  Measures.  Student  attitude  was  also  evaluated  with 
two  measures.  The  first  of  these  two  measures  was  the  Revised  Math 
Attitude  Scale,  a  Likert-type  questionnaire.  Learners  were  asked  to 
respond  to  20  statements  on  a  five  part  scale,  ranging  from  "Strongly 
Agree"  to  "Strongly  Disagree."  The  split-half  reliability  coefficient 
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of  the  survey  was  found  to  be  0.93. 

The  second  attitude  scale  used  in  this  study  was  the  School 
Attitude  Measure  (SAM).  The  SAM  Is  also  a  Likert-type  survey  that 
contains  85  questions  pertaining  to  attitudes  toward  school, 
teachers,  and  attitudes  towards  education  in  general.  Data  collected 
in  this  study  indicated  that  the  split-half  reliability  coefficient  of 
the  SAM  was  0.78. 

Prior  to  administering  the  attitude  scales,  the  learners  were 
assured  that  their  responses  would  be  judged  "blindly,"  and  that  their 
annonymity  would  be  protected.  They  were  then  encouraged  to 
respond  honestly  to  the  scales'  items. 

Problem-Solving  SIcills  Measures.  Two  measures  of  problem- 
solving  skills  were  used  in  this  study:  the  Test  of  Cognitive  Skills 
(TCS)  and  the  Test  of  Non-Routine  Problem-Solving  Skills  (TNRPSS). 

The  TCS  consists  of  four  sections:  "Memory,"  "Analogies," 
"Sequences,"  and  "Verbal  Reasoning."  Data  from  this  study  yielded  a 
split-half  reliability  coefficient  of  0.88  for  the  TCS 

The  Test  of  Klon-Routlne  Problem  Solving  Skills  was  developed 
by  this  author  in  consultation  with  teachers  familiar  with  teaching 
and  assessing  problem-solving  skills.  This  scale  consists  of  20 
Items  that  measure  non-routine  problem  solving  skills.  These 
problems  are  open-ended  In  nature  with  several  possible  solutions. 
The  learner  was  able  to  select  the  solution  strategy  he/she  wished  tc 
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employ  to  solve  the  problem.  This  test  was  scored  dichotomously, 
with  the  correct  answer  receiving  one  point  and  an  Incorrect  answer 
receiving  no  points. 

The  final  version  of  the  TNRPS5  was  obtained  by  analyzing 
test-Item  data  from  an  original  pool  of  85  Items.  The  split-half 
reliability  coefficient  of  the  final  version  of  the  TNRPSS  was  found 
to  be  0.76. 
Procedure 

Students  in  five  seventh  grade  mathematics  classes  were 
systematically  assigned  to  the  three  treatments  previously  described 
from  the  five  class  rosters. 

Students  were  then  designated  as  high,  average,  or  low  in  prior 
achievement  based  on  sixth  grade  CTBS  scores. 

Prior  to  the  beginning  of  the  study,  the  learners  were  Informed 
that  the  treatment  groups  would  be  rotated  after  the  Initial 
assignments  had  been  completed. 

Each  of  the  learners  was  then  subjected  to  their  respective 
treatments  for  two  Instructional  periods,  approximately  45  minutes 
each,  per  week  over  a  period  of  two  months,  20  sessions  In  all. 

At  the  end  of  the  experimental  period,  each  learner  was 
posttested  on  the  dependent  measures.  The  experimental  data  were 
analyzed  as  follows. 
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Experimental  Design  and  Data  Analysis 

Data  from  this  study  was  analyzed  through  a  fixed-effects 
ANOVA  for  each  of  the  dependent  measures.  The  design  of  the 
experiment  was  a  3  x  3,  two-factor  design,  featuring  three  levels 
each  of  treatment  group,  LOGO,  Problem-Solving,  and  Control,  and 
prior  achievement.  High,  Average,  and  Low. 

Dependent  measures  Included  two  measures  of  posttest 
achievement  (the  mathematics  subtests  of  the  Comprehensive  Test  o 
Basic  Skills  and  the  seventh  grade  Program  Criterion  Referenced 
IfiSD,  two  measures  of  student  attitude  (the  School  Attitude  Measure 
and  the  Revised  Math  Attitude  Scale),  and  two  measures  of 
problem-solving  skills  (the  Test  of  Cognitive  Skills  and  the  Test  of 
Non-Routine  Problem-Solving  Skills) 

Results 

Test  of  Cognitive  Skills 

The  cell  means  for  the  TCS  are  shown  In  Table  1.  Both 
achievement  level  means  and  treatment  group  means  were 
significantly  different  (p  =  .001)  as  shown  In  Table  2,  the  ANOVA  for 
this  result. 

The  Problem-Solving  Group  differed  significantly  from  the 
Control,  but  not  from  the  LOGO  group,  while  the  High  group  differed 
significantly  from  the  Low  group,  but  not  the  Average  Group. 
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Insert  Tables  1  and  2  about  here. 


Test  of  Klon-Rautlne  Problem-Solving  Skills 

The  cell  means  for  the  TNRPSS  are  listed  In  Table  3  and  the 
ANOVA  Is  found  In  Table  4.  These  means  did  not  differ  significantly 
(p  =  .05).  However,  the  mean  of  the  Problem-Solving  group  was 
significantly  larger  (p  =  .001)  than  the  means  of  the  Control  and  the 
LOGO  groups,  although  the  means  of  the  LOGO  and  Control  groups 
themselves  did  not  differ  significantly  (p  =  05). 


Insert  Tables  3  and  4  about  here. 


Comprehensive  Test  of  Basic  Skills 

The  cell  means  for  the  mathematics  CTB5  are  given  in  Table  5. 
There  was  no  signif  if  leant  treatment  main  effect  (p  =  .05),  as  shown 
in  the  analysis  of  variance  table.  Table  6.  However,  the  achievement 
means  were  significantly  different  (p  =  .001).  Specifically,  the  High 
group  scored  significantly  higher  than  either  the  Average  or  Low 
group.  However,  the  means  of  the  Average  and  Low  groups  were  not 
significantly  different  (p  =  .05). 
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Insert  Tables  5  and  6  about  here. 


Program  Criterion  Referenced  Test 

The  means  for  the  achievement  level  groups  were  all 
significantly  different  for  the  PCRT  (p  =  .001).  However,  there  were 
no  significant  differences  among  the  treatment  group  means  (p  =  .05). 


Insert  Tables  7  and   .bout  here. 


Revised  Math  Attitude  Scale 

The  cell  means  for  the  RMAS  are  given  In  Table  9  and  the 
ANOVA  Is  shown  In  Table  10.  The  means  for  the  treatment  groups 
were  significantly  different  (p  =  .001).  Both  the  LOGO  and 
Problem-Solving  group  means  were  significantly  greater  than  that  of 
the  Control  group.  However,  the  means  of  the  Problem-Solving  and 
LOGO  groups  themselves  were  not  statistically  different  (p  =  .05). 

In  addition,  the  mean  for  the  Low  group  differed  significantly 
from  the  mean  of  the  High  group  (p  =  .05).  However,  the  means  of  the 
Low  and  Average  groups  did  not  differ  significantly,  nor  did  the  means 
of  the  Average  and  High  groups  (p  =  .05). 

In  addition  to  these  main  effects,  there  was  also  a  significant 
(p  =  .001)  Interaction  between  treatment  and  achievement.  This 
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Interaction  Is  plotted  In  Figure  1. 


Insert  Tables  9  and  10  and  Figure  I  about  here. 


School  Attitude  Measure 

Cell  means  for  the  SAM  are  given  In  Table  II.  Neither 
treatment  group  means  nor  the  achievement  group  means  differed 
significantly  (p  =  .05) ,  as  shown  In  Table  12,  the  ANOVA  table  for 
this  measure. 


Insert  Tables  1 1  and  12  about  here. 


Discussion 

There  are  three  main  results  from  this  study  that  warrant 
further  discussion  and  analysis.  First,  neither  treatment  group,  LOGO 
or  The  Problenn-Solving  strategies  group,  demonstrated  any 
improvement  in  basic  skills  achievement  as  the  result  of  the 
experimental  Intervention. 

Much  of  the  research  on  mastery  based  Instructional  programs 
has  supported  the  notion  that  t!(e  learner  must  actively  become 
Immersed  in  the  knowledge  or  skill  that  is  being  learned  for  mastery 
to  become  a  reality.  In  this  study,  no  such  intensive  basic  skills 
learning  took  place.  Although  this  type  of  basic  skills  instruction  is 
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not  the  aim  of  LOGO  there  have  been  many  assertions  made  as  to  the 
efficacy  of  LOGO  In  Improving  the  basic  skills  achievement  of 
learners.  The  results  of  this  experiment  indicate  that  neither  LOGO, 
nor  more  conventional  problem-solving  instruction,  produce  Improved 
learner  achievement.,  principally  due  to  the  lack  of  focus  on  these 
skills. 

Second,  the  Problem-Solving  group  scored  significantly  higher 
than  did  the  Control  or  LOGO  groupon  both  measures  of  problem- 
solving  skills.  In  this  case,  learners  given  specific  Instruction  In 
problem-solving  strategies  were  able  to  apply  this  new  knowledge  to 
a  variety  of  new  problems,  whereas  learners  subjected  to  a  more 
general  learning  experience  such  as  LOGO  were  not  able  to  respond 
appropriately  to  new  situations.  This  result  again  supports  the  body 
of  conventional  research  that  asserts  that  specific,  well-designed 
Instructional  Interventions  can  have  positive  Impacts  on  learning 
outcomes.  In  addition,  this  result  suggests  that  LOGO'S  "top-down" 
thinking  model  may  not  transfer  to  problems  outside  of  the  LOGO 
context. 

Finally,  although  there  were  no  significant  results  on  the 
School  Attitude  Measure,  there  were  highly  significant  differences  on 
the  Revised  Math  Attitude  Scale.  The  SAM  measures  a  variety  of 
general  attitudes  towards  school,  teachers,  and  learning.  These 
attitudes  are  Influenced  by  years  of  development,  as  well  as  a  variety 
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of  factors  outside  of  the  school  itself.  It  m^^y  therefore  be  logical  to 
conclude  that  a  much  more  dramatic  treatment  must  be  employed  over 
a  longer  time  frame  In  order  to  produce  significant  changes  In  this 
type  of  evolved  attitude  trait. 

However,  learners  in  the  L060  and  Problem-Solving  groups 
scored  significantly  higher  than  their  counterparts  In  the  Control 
group  on  the  Revised  Math  Attitude  Scale.  Yet,  neither  treatment, 
LOGO  nor  Problem-Solving,  scored  significantly  better  than  the  other. 
Both  of  these  treatments  represented  something  different  from  the 
normal  classroom  routine  of  these  students.  Therefore,  It  Is  likely 
that  these  Improved  attitudes  are,  in  some  part,  attributable  to  a 
novelty  effect. 

Finally,  the  significant  Achievement  by  Treatment  interaction 
p-^esent  with  the  RMA5  indicates  that  Low  learners  in  the  LOGO  and 
Problem-Solving  groups  scored  far  higher  than  High  or  Average  level 
learners,  while  Average-level  learners  seemed  to  prefer  the 
Problem-Solving  treatment  overall,  while  High  learners  responded 
favorably  only  to  the  LOGO  treatment. 

These  results,  coupled  with  observations  made  during  data 
collection  Indicate  that  the  novelty  effect  earlier  mentioned  is  most 
pronounced  for  the  Low  learners,  who  have  generally  been 
unsuccessful  with  conventional  classroom  instructional  practices.  It 
is  this  type  of  student  that  Papert  (1980)  suggests  is  benefited  most 
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greatly  by  LOGO.  However,  the  results  from  this  study  indicate  that 
virtually  ao^ new  Intervention,  especially  one  In  which  success  comes 
quickly  and  easily.  Is  llkel"  tO  produce  substantial  improsaments  in 
the  attitudes  of  low  learners. 

The  favorable  attitudes  of  .\verage-ab111ty  stuaents  towrrd  the 
material  in  the  Problem-Solving  treatment  may  result  from  .he  fact 
that  these  materials  were  designed  spe(  ^ically  for  average" 
learners.  In  t'.ddit1on,  many  of  these  learners  have  had  a  varlet/  of 
computer  experiences  In  previous  math  classes  and  In  otner  content 
areas.  Therefore,  the  novelty  effect  may  have  been  less  stror^  for 
these  learners. 

High  learners  also  responded  favorably  to  LOGO,  but  less 
favorably  to  the  Problem-Solving  treatment.  This  re  .  Is  likely  due 
to  the  materials  of  the  Problem-Solving  treatment  were  somewhat 
simplistic  for  their  ability  level.  Observations  indicated  that  high 
level  learners  often  developed  their  own  problems  to  solve  in  the 
LOGO  environment  Solving  this  type  of  personal  problem  was 
undoubtedly  more  challenging  and  rewarding  to  these  students. 

In  summary,  the  resultj  of  this  study  suggest  that  the 
problem-solving  skills  fostered  through  LOGO  use  may  not  transfe'^ 
outside  the  context  of  LOGO,  since  LOGO  apparently  provides  only  a 
single  algorithm  wh.cn  may  not  apply  to  many  t/pes  of  non-routine 
problems.  In  contrast,  the  problem-solving  strategies  taught  as  part 
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of  the  Problem-Solving  treatment  were  highly  effective  In  Improving 
the  problem-solving  skills  of  these  learners.  Both  the  LOGO  group  and 
the  Problem-Solving  group  demonstrated  an  improvement  In  attitudes 
related  to  mathematics  instruction.  This  Improvement  was,  in  part, 
attributed  to  a  novelty  effect. 

Neither  treatment  group  demonstrated  an  Improvement  In  more 
general  attitudes  or  basic  skills  achievement.  This  lack  of 
improvement  was  attributed  to  the  lack  of  a  specific  focus  on  these 
two  constructs,  by  the  materials  in  these  treatments.  The  results  of 
this  study  suggest  that  specific,  well  designed  interventions  targeted 
at  specific  types  of  learning  can  be  effective  in  producing 
Improvements  in  these  learnings.  However,  non-specific 
interventions  such  as  LOGO  may  not  be  nearly  as  effective. 

It  should  be  noted  that  the  LOGO  treatment  used  in  this  study 
was  only  one  of  many  possible  applications  of  LOGO  and  it  is  possible 
tnat  other  applications  of  LOGO,  over  longer  periods  of  time,  wouK 
produce  different  results  and  more  research  with  these  applications 
should  be  conducted.  However,  based  on  the  rt.sjlts  of  this  study, 
LOGO  does  not  produce  the  effects  often  suggested  by  its  proponents. 
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Table  1 .    Mean  percent  scores  for  the  Test  of  Cognitive  Skills  (TCS). 


Control         PS  LOGO  TOTAL 


43.05 

59.03 

52.50 

51.49 

Low 

(N=9) 

(n=9) 

(n=8) 

(n=26) 

60.18 

76.81 

67.19 

69.38 

Average 

(n=7) 

(n=ll) 

(n=8) 

(n=26) 

74.75 

7'j.58 

75.62 

76.04 

High 

(n=10) 

(n-7) 

(n=12) 

(n=29) 

59.85 

71.34 

66.61 

66.01 

TOTAL 

(n=26) 

(n-27) 

(n=28) 

(n=81) 

o 

ERIC 


The  Efficacy  LOGO 
2; 


Table  2.    Fixed-effects  analysis  of  variance  for  the  Test  of 
Cognitive  Skills  (TrS) 


sv 

ss 

df 

MS 

F 

Treatment  (T) 

1217.21 

2 

608.60 

7.22a 

Achievement  (A) 

5409.43 

2 

2704.72 

32.08^ 

TA 

305.77 

4 

76.44 

0.91 

s:TA 

6070.32 

72 

84.31 

ap<.00l 
'^p<.001 
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Table  3.    Mean  percent  scores  for  the  Test  of  Non-Routine 
Problem-Solving  Skills  (TNRPSS). 

Control  PS  L060  TOTAL 


25.00  50.56  21.25  32.69 

Low  (n=9)  (n=9)  (n=8)  (n=26) 


21.43  47.27  27.50  34.23 

Average  (n=7)  (n=n)         (n=8)  (n=26) 


.00  54.29  29.58  36.72 

High  (n=IO)         (n=7)  (n=l2)  (n=29) 


27.12  5019  26.61  34.63 

TOTAL  (n=26)         (n=27)         (n=28)  (n=8l) 
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Table  4    Fixed-effects  analysis  of  variance  for  the  Test  of 


Non-Routine  Prnblem-SolvInQ  Sklllc;  (TNRPSS). 


sv 

ss 

df 

MS 

F 

Treatment  (T) 

10388.95 

2 

5194.47 

20.313 

Achievement  (A) 

825.27 

2 

412.64 

1.61 

TA 

331.24 

4 

82.81 

0.32 

s:TA 

18417.96 

72 

255.81 

3p<.001 
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Table  5.    Mean  percent  scores  for  the  mathematics  Comorehenslve 
Test  of  Rafale  Skills  (CTBS). 

Control         PS  LOGO  TOTAL 


58.39         58.04         62.35  59.41 
Low  (n=8)  (n=9)  (n=7)  (n=24) 


68.24  7401  80.15  74.59 

Average  (n=6)         (n=ll)        (n=8)  (n=25) 


87.69  91.47  88.24  88.85 

High  (n=13)        (n=8)         (n=10)  (n=31) 


7468  73.87  78.40  75.55 

TOTAL  (n=27)        (n=28)        (n=25)  (n=80) 
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Tables.    Fixed-effects  analysis  of  variance  for  the  mathematics 
Comprehensive  Test  of  Basic  Skills  (CTBS). 


SV  ss  df         MS  F 


Treatment  (T) 

266.07 

2 

133.03 

0.71 

Achievement  (A) 

8376.86 

2 

4188.43 

22.43a 

TA 

270.26 

4 

67.57 

0.3o 

s:TA 

13256.39 

71 

212.09 

3p  <.001 
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Table  7.    Mean  percent  scores  for  the  Program  Criterion  Referenced 
IfiSKPCRT). 


Control  PS  L060  TOTAL 


49.63 

49.33 

53.00 

50.50 

Low 

(n=8) 

(n=9) 

(n=7) 

(n=24) 

58.00 

62.91 

68.13 

63.40 

Average 

(n=6) 

(n=11) 

(n=8) 

(n=25) 

74.54 

77.75 

75.00 

75.52 

High 

(n=13) 

(n=8) 

(n=10) 

(n=31) 

63.48 

62.79 

66.64 

71.01 

TOTAL 

(n=27) 

(n=28) 

(n=25) 

(n=80) 
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Tables.    Fixed-effects  analysis  of  variance  for  the  Program 
Criterion  Referenced  Test  (PCRT). 


SV  ss  df  MS  F 


Treatment  (T) 

665.87 

2 

332.94 

1.91 

Achievement  (A) 

16253.54 

2 

8126.77 

46.733 

TA 

1242.17 

4 

310.54 

1.79 

s:TA 

12347.31 

71 

173.91 

ap<.001 
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Table  9.    Mean  percent  scores  for  the  Revised  Math  Attitude  Scale 
(RMAS). 

Control         PS  LOGO  TOTAL 


57.50  73.00  7400  67.97 

Low  (n=IO)         (n=IO)         (n=9)  (n=29) 


62.90  69.15  67.44  66.72 

Average  (n=10)         (n=13)         (n=9)  (n=32) 


62.08  61.22  68.69  6431 

High  (n=13)         (n=9)  (n=13)  (n=35) 


60.94  68.13  69.87  69.22 

TOTAL  (n=33)         (n=32)         (n=31)  (ri=96) 
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Table  10.  Fixed-effects  analysis  of  variance  for  the  Revised  Math 
Attitude  Scale  (RMAS). 


5V 

ss 

df 

MS 

F 

Treatment  (T) 

1417.25 

2 

708.62 

22.323 

Achievement  (A) 

208.01 

2 

10400 

3.28^ 

TA 

859.59 

4 

214.90 

6.77C 

S:TA 

2761.64 

87 

31.74 

3p<.001 
^,01  <p<.05 
Cp<.001 
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Table  n.  Mean  percent  scores  for  the  School  Attitude  Measure 
(SAM). 

Control  PS  LOGO  TOTAL 


Average 


High 


TOTAL 


69.63 
(n=10) 


70.53 
(n=10) 


71.56 
(n=13) 


70.66 
(n=33) 


7066 
(n=10) 


72.43 
(n=13) 


69.10 
(n=9) 


7094 
(n=32) 


67.01 
(n=Q) 


72.33 
(n=9) 


73.46 
(n=13) 


71.32 
(n=31) 


69.17 
(n=29) 


71.87 
(n=32) 


71.63 
(n=35) 


7097 
(n=96) 
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Table  12.  Fixed-effects  analysis  of  variance  for  the  School  Attitude 
Measure  (SAM). 


sv 

ss 

df 

MS 

I- 

Treatment  (T) 

30.24 

2 

15.12 

0.02 

Achievement  (A) 

13!  1.86 

2 

655.93 

0.97 

TA 

1914.78 

4 

4/8.69 

0.71 

S:TA 

58673.83 

87 

674.41 

1^1 
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Figure  Cuptton 

Figure  1.  Achlevement-by-Treatment  Interaction  for  the  '^'^"'^ 
Math  Attitude  Sr.ale  (RMAS). 
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The  Effects  of  Video-only,  CAI  only,  and  Interactive  Video 
Instructional  Systems  on  Learner  Performance  and  Attitude:  An 

Exploratory  Study 

Computer-assisted  instruction  (CAI)  has  ..ad  beneficial  effects 
on  learner  achievement  in  a  wide  variety  of  instructional  settings. 
Research  has  shown  that  CAI  not  only  Improves  learner  achievement, 
at  times  by  as  much  as  50%,  but  can  also  reduce  the  amount  of  time 
necessary  to  accomplish  the  same  amount  of  learning  (Kulik,  1983). 

CAI  has  been  effective  with  a  wide  variety  of  learners  and  in 
many  different  types  of  instructional  settings  (Charp,  1981).  In 
addition,  CAI  has  had  positive  effects  on  improving  the  affective 
outcomes  of  instruction,  such  as  learner  attitude  and  self-esteem 
(Dalton  &  Hannafin,  1985;  Clement,  1981).  The  favorable  attitudes  of 
learners  who  participate  in  computer-assisted  Instructional 
programs  have  been  attributed  to  the  fact  that  the  computer  had 
infinite  patience,  never  showed  signs  of  anger  or  frustration,  and  left 
the  learners  with  a  general  feeling  of  having  learned  "better." 

Yet,  despite  the  many  instructional  benefits  associated  with 
the  use  of  CAI,  there  are  many  instructional  situations  in  which  CAI 
simply  is  not  adequate  (Martorella,  1983).  For  example,  computer 
generated  graphics  are  generally  not  capable  of  depicting  intricate, 
visually-oriented    instructional    sequences,    such    as  surgical 
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procedures  or  flight  training,  with  the  realism  that  Is  required. 

On  the  other  hand,  video  Images  can  present  Instruction  with  a 
realism  that  Is  not  possible  In  CAI.  However,  although  video-based 
Instruction  has  been  effective  In  many  situations,  the  many 
instructional  benefits  of  the  typical  CAI  are  lost  (Russell,  :984). 
Since  video-based  instruction  is  generally  non-interactive,  the 
possibilities  for  individualized  pacing,  feedback,  and  reinforcement 
are  greatly  diminished. 

hiany  authors  note  that  v</jeo  often  becomes  a  passive 
Instructional  medium  where  learners  do  not  actively  participate  in 
the  learning  and  hence,  simply  "turn-off"  to  the  instruction  (Gendele 
&6endele,  1984). 

In  the  past  decade,  computer  and  video  technologies  have  been 
merged  to  form  a  new  promising  media  known  as  "interactive  video." 
With  this  new  technology,  the  learners  are  shown  a  segment  of  video 
instruction  and  asked  questions  about  that  segment  by  the  computer. 
The  computer  can  then  perform  the  sam?  functions  as  it  does  In  more 
conventional  CAI:  Inputting  and  Judging  the  learners'  responses, 
providing  feedback  and  reinforcement,  and  record  keeping. 

The  possibilities  for  improving  CAI  with  video  Images  through 
interactive  video  instruction  seem  very  promising.  Current  research 
indicates  that  the  variety  of  visual  and  auditory  learning  stimuli 
present  in  interactive  video  can  dramatically  Improve  learning  (Clark, 
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1984). 

In  addition,  a  recent  study  noted  that  the  interactive  nature  of 
interactive  video  can  not  only  improve  short-range  recall,  but  can 
also  aide  in  retention  (Schaffer  &  Hannafin,  1964).  However,  this 
study  also  demonstrated  that  excessive  amounts  of  interactivity  in 
interactive  video  do  not  appreciably  effect  performance  or  retention, 
but  drastically  impact  the  efficiency  of  the  instruction  presented. 

Although  the  many  assumptions  made  about  interactive  video 
make  it  seem  ideally  suited  for  many  educational  and  training 
settings,  there  ar?  many  questions  concerning  the  use  of  Interactive 
video  technology  that  have  yet  to  be  answered.  This  study  compared 
the  effects  of  interactive  video  instruction  on  learner  performance 
and  attitude,  with  conventional  CAI  and  stand-alone  video,  in  order  to 
determine  exactly  what  types  of  learning  tasks  best  lend  themselves 
to  interactive  video  instruction 

MaterlalS-andJIethods 

The  134  subjects  for  this  study  were  selected  from  six 
Introductory  level  junior  high  Industrial  Arts  Exploration  classes.  The 
basic  learning  consisted  of  a  set  of  27  General  Shop  Safety  Rules.  In 
genero.,  each  of  the  rules  Involved  a  visually-oriented  task  or 
behavior  required  of  the  learners.  Three  parallel  forms  of  instruction 
were  employed:  Video-only,  CAI  only,  and  Interactive  Video.  The 
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video-only  33son  consisted  of  a  15  minute  video  oresentation  on  the 
saf3  use  of  tools.  Learners  were  shown  a  short  narrated  segment  that 
depicted  both  an  example  and  non-example  of  the  correct  behavior. 
The  CAI-only  lesson  used  the  narrator's  script  as  the  basis  of  a 
tutorial  lesson.  The  interactive  video  lesson  combined  the  video 
segmonts  from  the  video  lesson  with  the  tutorial  from  the  CAI  lesson. 

Prior  to  the  beginning  of  the  study,  the  learners  were 
designated  as  relatively  high  or  low  in  prior  achievement  based  on 
their  sixth  grade  total  Comprehensive  Test  of  Rasir  Skills  scores. 
They  were  then  randomly  assigned  to  one  of  the  three  treatment 
groups  described.  At  the  conclusion  of  the  lesson,  the  learners  were 
given  a  print-based  posttest,  covering  the  rules  that  had  been 
presented  in  the  three  treatments,  and  a  survey  to  address  their 
attitudes  towards  the  instruction. 

Design  and  Procedures 

This  study  employed  a  completely  crossed  3x2x2  treatment 
by  achievement  by  sex  factorial  design,  featuring  3  levels  of 
treatment  (video  only,  CAI  only,  and  interactive  video),  and  three 
levels  of  prior  achievement  (high,  average,  and  low)  based  on  CTBS 
scores.  Dependent  measures  Included  one  measure  of  nerformance  and 
one  mc.  ;ure  of  attitude  toward  instruction. 

Posttest  performance  scores  were  analyzed  with  ANCOVA 
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procedures,  using  prior  achievement  as  the  covariate.  Attitude  scores 
were  analyzed  with  ANOVA  procedures. 

Findings 

The  means  for  the  treatment  groups  on  the  performance 
measure  were  64.98X,  73.54%,  and  70.48%  for  the  Video,  CAI,  and 
Interactive  Video  treatments,  respectively.  The  means  of  all  three 
groups  were  significantly  different  at  the  alpha  =  .05  level. 

In  order,  the  attitude  scale  means  of  the  Video,  CAI,  and 
Interactive  Video  treatment  groups  were  75.07%,  7426%,  and  82.87%. 
The  rrean  of  the  Interactive  Video  group  was  significantly  higher  than 
both  the  CAI  and  Video  only  groups  at  the  alpha  =  .005  level.  However, 
the  means  of  the  Video  group  and  the  CAI  group  were  not  statistically 
different. 

In  addition  to  the  treatment  main  effect  on  the  attitude  scale, 
there  was  also  a  significant  Achievement  by  Treatment  Interaction. 

Implications  of  tho  Study 

There  are  three  major  findings  from  this  study  that  warrant 
discussion:  a)  CAI  alone  tends  to  the  the  most  effective  instructional 
d6l1v«»ry  system  for  the  type  of  learning  task  chosen  for  this  study, 
b)  interactive  video  instruction  produced  significant  improvements  in 
learner  attitudes  when  compared  with  CAI  and  Video  alone,  and  c)  the 
attitude  effects  observed  in  this  study  were  not  constant  across  prior 
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achievement  level. 

It  might  be  assumed  that  the  Interactive  video  treatment,  by 
virtue  of  Its  video  enhancements  and  Individualization,  would  be  the 
most  effective  In  producing  high  levels  of  performance.  However, 
this  assumption  was  not  supported  by  this  study  for  two  principal 
reasons.  First,  the  Interactive  video  equipment  was  very  new  to 
these  students.  Observations  made  during  the  lessons  indicate  that 
these  learners  were  somewhat  distracted  by  the  various  noises  and 
indicator  lights  produced  by  the  videotape  players  In  this  treatment. 
Second,  the  delays  caused  by  long  tape  access  times  may  have  given 
the  learners  the  opportunity  to  drift  and  not  actively  participate  In 
the  Instruction.  On  the  other  hand,  these  learners  were  familiar  with 
CAI  lessons,  so  this  media  provided  no  such  distractions  and  Its  more 
direct  nature  seemed  to  keep  ihese  learners  more  "on  task." 

Although  the  learners  using  the  CAI  lesson  performed  best,  the 
interactive  video  lesson  was  succesc'ul  in  improving  learner 
attitudes  towards  the  instruction.  This  Improvement  in  learner 
attitude  may  be  the  result  of  the  more  motivating  nature  of  the 
"natural"  video  Images  or  the  immediate  reinforcement  provided  by 
the  computer  (Bejar,  1982).  Unfortunately,  as  noted  earlier,  the 
learners  Involved  in  this  study  had  never  used  this  kind  of  delivery 
system  before.  Therefore,  the  differences  in  observed  attitudes  may, 
In  part,  be  at>".rlbutable  to  a  novelty  effect. 
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However,  the  most  Important  finding  of  this  study  Is  that  the 
attitude  differences  observed  varied  across  prior  achievement  level. 
Specifically,  low  ability  students  scored  dispropotlonately  lower  on 
the  CAI  lesson  than  low  learners  In  the  other  treatment  groups.  What, 
then,  could  sccount  for  this  strongly  negative  reaction  to  the  CAI 
treatment  by  low  ability  learners? 

'n  the  school  chosen  to  participate  In  this  study,  CAI  has  been 
used  for  approximately  four  years,  primarily  for  remediating  the 
basic  skills  deficiencies  of  low-ability  learners.  Perhaps  CAI,  when 
used  only  In  a  remedial  capacity,  can  have  the  same  stigmatizing 
effects  often  observed  with  low  ability  learners  are  placed  in 
conventional  "special"  programs.  The  results  of  this  study  support 
the  notion  that  a  great  deal  of  care  Is  waranted  In  the  use  of  CAI,  and 
remedial  programs  In  genera),  If  these  detrlmetal  effect  are  to  be 
avoided. 

In  summary,  the  results  of  this  study  Indicate  that  CAI  can  be  a 
highly  effective  mode  of  Instruction  where  the  additional  capabilities 
provided  by  Interactive  video  are  not  required.  In  addition,  both 
interactive  video  and  CAI  are  more  effective  in  producing  high  levels 
of  performance  than  video  only,  substantially  due  to  their  ability  to 
l<eep  learners  more  actively  participating  in  the  learning.  Finally, 
although  CAI  can  be  used  to  effectively  improve  learner  attitude,  like 
other  types  of  instructional  media,  CAI  can  have  deliterious  effects 
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on  learner  attitude  if  used  in  a  manner  where  low  ability  learners 
feel  demeaned  or  isolated  because  of  their  additional  needs. 
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Abstract 

Although  highly-designed,  outcome-based  computer-based 
Instructional  Interventions  have  been  successful  In  Inproving  the 
basic  skills  of  learn'irs  in  a  wide  variety  of  educational  settings, 
little  research  has  been  conducted  on  more  open-ended  computer 
learning  activities,  such  as  word  processing. 

The  present  study  examined  the  effects  of  a  year-long  word 
processing  program  on  learners'  hollistic  writing  skills.  Learners 
were  in  the  treatment  group  used  a  word  processor  three  times  per 
week  to  )mp1ete  their  writing  assignments,  while  students  in  the 
control  used  conventional  print-based  writing  techniques. 

Results  from  this  study  suggest  that  word  processing  is 
especially  effectivp  for  low  ability  su'ients.  However,  there  were 
several  logistical  problems  related  to  access  to  the  computers 
encountered  during  the  stuoy  that  may  have  prevented  more  dramatic 
results. 
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WORD  PROCESSING  AND  THE  WRITING  PROCESS: 
ENHANCEMENT  OR  DISTRACTION? 

Introduction 

Highly-designed,  outcome-based  computer-assisted  instruction 
(CAI)  has  been  effective  in  a  wide  variety  of  instructional  settings 
(Kulik,  1983).  Yet,  it  has  been  suggested  that  the  great  potential 
benefits  of  instructional  applications  of  computer-based  technologies 
lie  in  more  open-ended  computer  activities  such  as  word  processing, 
where  the  computer  is  U3ed  more  as  a  learning  tool  than  as  an 
electronic  tutor  (Dudley-Marling,  1985). 

Traditionally,  writing  skills  have  been  taught  by  two  dib  net 
approaches:  the  reductive  approach  and  the  hollistic  approach 
(Hartwell,  1985).  In  the  reouctive  approach,  wr'ting  is  taught  by 
focusing  on  discrete,  often  isolated  mechanical  skills,  including 
punctuation,  syntactical  rules,  etc. 

The  hollistic  approach  concentrates  attention  on  the  prore«;s  of 
writing  and  largely  neglects  Instruction  in  specific  mechanics,  the 
assumption  being  that  if  learners  concentrate  on  the  meaning  and  the 
production  of  the  text  as  a  whole,  the  mechanical  skills  will  follow. 
With  this  approach,  learners  are  taught  that  the  writing  process 
consists  of  three  distinct  steps:  pre-writing  or  planning,  writing,  and 
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most  Imoortantly,  revision  (sae  Figure  1 ).  This  approach  to  writing 
instruction  is  now  the  most  popular  (Moffet,  1968). 


Insert  Figure  I  about  here. 


There  is  evidence  to  support  the  efficacy  of  the  hollistic 
approach  to  writing  instruction.  In  a  study  comparing  the  two 
approaches,  no  significant  differences  were  found  in  the  writing 
quality  between  treatment  groups,  leading  the  authors  to  contl^ 
that  the  reductive  approach,  while  leading  to  better  mechar.r  ;a1 
skills,  does  not  improve  the  overall  quality  of  the  writing  product 
(Meckel,  1963).  In  addition,  it  has  been  noted  that  the  hollistic 
'^■>proach  can  be  especially  effective  in  improving  the  writing  skills 
of  low-achieving  learners,  since  these  students  tend  to  get 
bogged-down  with  the  form,  rather  than  the  substance  of  the  text 
(Rose,  1983). 

In  a  recent  review  of  the  literature  comparing  the  two 
approaches  to  writing  instruction.  It  was  noted  that  some  authors 
found  that  mechanical  approaches  can  often  have  dellterious  effects 
on  the  overall  quality  of  students'  writing  (Hartwell,  1985). 

To  date,  computers  have  been  used  to  support  writing 
mechanics  through  th*"  "se  of  drill  and  practice  and  tutorial  CAI.  The 
RSVP  project  conductea  In  the  Mlami/Daje  County  schools  found  that 
this  type  of  computer  instruction  did  improve  the  learners' 
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mechanical  skills,  but  had  no  discemable  impact  on  the  overall 
quality  of  their  writing  products.  The  "Writing  to  Read"  project 
sponsored  by  IBM  (Blum  &  Furlong,  1983)  has  also  supported  this  lacic 
of  efficacy  of  the  reductive  approach. 

The  potential  benefits  of  word  processing  technology  in 
assisting  learners  within  the  hollistic  approach,  especially  in  the 
revision  portion  of  the  process,  seem  somewhat  obvious.  Yet,  very 
little  empirical  stud/  has  been  conducted  to  date.  A  recent  study 
conducted  with  elementary  students  reported  that  t^>e  inclusion  of 
word  processors  in  the  writing  program  produced  cignificant 
improvements  in  the  attitudes  of  the  learners  (Wilier,  1985) 
Specifically,  it  was  noted  that  the  learners  involved  in  the  study  had 
favorable  attitudes  towards  the  revision  process  when  accomplished 
on  the  microcomputer  and  spent  more  time  in  the  revision  process.  In 
addition,  favorable  results  have  been  reported  when  word  processors 
have  been  used  with  primary  age  learners  (Phenix  &  Hannan,  1 985) 

Although  the  potential  of  word  processing  in  aiding  the  writing 
process  seems  great  with  elementary  learners,  many  questions  as  to 
the  efficacy  of  this  technology  with  other  populations  remafn. 

This  study  examined  the  effects  of  a  year-long  hollistic 
writing  program  that  used  word  processing  technology  to  aide 
learners  in  revising  their  writing  on  learners'  writing  skills. 
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Methods 

The  subjects  of  this  study  were  80  seventh  grade  students, 
drawn  from  four  remealal  language  arts  courses.  Learners  were 
placed  In  the  remedial  programs  based  on  below-average  sixth  grade 
rnmprehenslve  Tpst  of  Basic  Skills  (CTBS)  scores  and  through  the 
reccommendatlons  of  their  sixth  grade  teachers.  Although 
below-average  In  language  skills,  many  of  these  learners  possessed 
average  to  above-average  skills  In  other  content  areas,  such  as 
mathematics  and  science. 
M^tPrials 

Two  treatments  were  employed:  a  word  processing  treatment 
and  a  conventional  writing  process  treatment. 

Word  processing  treatmenl:  Over  a  period  of  one  academic 
year,  students  In  the  word  processing  group  completed  all  of  their 
respective  writing  assignments  on  an  Apple  lie  microcomputer 
equipped  with  the  FreeWrlter  word  processslng  program. 
FreeWrlter  program  Is  a  moderately  powerful  public  domain  word 
processing  program  which  possesses  editing  features  Including  the 
abilities  to  find  and  rc-piace  errors,  move  text  blocks,  and  format 
documents  on  screen.  Each  student  was  furnished  with  their  own 
word  processing  and  data  diskettes  and  provided  with  aproximately 
three  instructional  periods  of  computer  time  per  week. 

The  students  were  given  two  weekly  v/rltinc  exercises  to 
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complete  on  the  word  processor.  This  exercises  included  developing 
fictional  short  stories,  writing  letters,  and  expository  prose.  These 
exercises  typically  required  the  learner  to  produce  between  one  and 
two  pages  of  text  each.  In  addition  to  the  writing  exercises,  the 
students  completed  four  major  written  papers.  The  students  were 
given  a  general  topic  and  asked  to  produce  a  final  printed  document  of 
between  three  and  five  pages. 

Conventional  writing  pronram  Students  in  the  conventional 
writing  program  used  pen-and-paper  methods  to  complete  the  came 
types  of  writing  activities. 

Prnrftriire 

Prior  to  the  beginning  of  the  study,  the  learners  were 
designated  as  relatively  high  or  low  in  prior  writing  achievement 
based  on  results  of  a  writing  pretest. 

The  learners  were  then  assigned  to  their  relative  treatment 
groups  were  they  completed 

At  the  conclusion  of  the  study,  the  learners  w«re  given  a 
standardized  writing  test,  which  was  scored  by  three  independent, 
"blind"  examiners.  The  evaluations  of  each  of  the  three  examiners 
was  combined  to  form  a  combined  score. 

These  writing  samples  were  evaluated  by  each  examiner  on  the 
following  five  criteria:  structure  and  organization,  correct  usage  of 
the  parts  speech,  punctuation,  capitalization,  and  spelling. 
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Experimental  Design  and  Data  Analysis 

The  design  of  this  study  was  a  2  x  2  completely  crossed 
treatment  by  achievement  factorial  design,  featurino  two  levels  of 
treatment  (word  processing  and  conventional  writing^,  and  two  levels 
of  prior  achievement  (high  and  low). 

Posttest  writing  sample  scores  were  analyzed  with  ANOn^A 
procedures. 

Results 

The  percent  cell  means  for  the  writing  sample  are  given  In 
Table  1.  (Verall,  the  mean  of  the  relatively  high  achieving  learners 
was  77.56%,  while  the  mean  of  the  relatively  low  achleveing  learners 
was  71.06%.  These  means  were  significantly  different  at  the  p  «  .01 
level  as  shown  In  Table  2,  the  analysis  of  variance  table  for  thii 
result. 


Insert  Tables  1  and  2  about  here. 


The  mean  for  the  word  processing  group  was  75.69%,  while  the 
mean  of  the  conventional  writing  group  was  72.94%.  These  means 
were  not  significantly  different.  However,  there  was  a  significant  (p 
=  10)  Achievement  by  Treatment  Interaction.  This  interaction  is 
depicted  graphically  in  Figure  2. 
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Insert  Figure  2  about  here. 


Discussion 

There  are  two  results  from  this  study  that  wan  ant  further 
discussion.  First,  there  was  a  significant  achievement  by  treatment 
interaction.  This  Interaction  indicates  that  the  relatively  low 
achieving  learners  scored  significantly  better  if  they  used  the  word 
processing  treatment  than  low  learners  in  the  conventional. 

This  result  supports  much  of  thp  previous  research  that 
suggests  that  the  writing  sicills  of  low  achieving  learners  and  oth&r 
special  populations  can  be  greatly  benefited  by  word  processing 
technology  even  though  other  types  of  "special"  interventions  have  had 
little  effect. 

In  addition,  this  result  and  observations  made  during  the  study 
support  the  notion  that  word  proceLsing  can  make  the  revision 
process  more  racile  and  less  frustratii  i  for  these  learners. 
Specifically,  the  teachers  Involved  in  this  study  noted  that  the 
learners  using  the  word  processor  required  less  encouragement  to 
revise  drafts  of  their  writing  assignments  and  generally  spent  more 
time  In  thr  revision  process  than  their  counterparts  using  pencil  and 
paper  methods. 

Interviews  conducted  with  learners  in  this  study  suggest  that 
the  v«ord  processor  made  the  writing  process  more  pleasant  because 
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correcting  errors  was  simplified  and  the  computer  eliminated  much 
of  the  physical  discomfort  with  which  many  cf  these  learners  have 
associated  the  writing  act. 

However,  it  should  be  noted  that  there  '-vao  no  treatment  main 
effect  observed  in  this  study.  Specifically,  word  processing  was  not 
effective  for  the  relatively  high  ability  students.  Observations 
conducted  during  the  study  and  interviews  conducted  at  the 
conclusion  of  the  study  indicate  that  this  lack  of  efficacy  was  the 
result  of  two  main  factors. 

First,  many  students  had  significant  trouble  in  keyboarding. 
Learners  at  this  age  level  have  been  exposed  to  little  formal  typing 
instruction.  As  a  result,  they  spend  an  inordinately  large  amount  of 
time  "hunting"  about  the  keyboard  before  the  can  "peck"  a  key.  Many 
learners  stated  that  the/  fou.  .his  task  excessively  time  consuming 
and  distracting  when  compared  with  pencil  and  paper  writing.  In  fact, 
several  noted  that  typing  problems  effectively  Interrupted  their 
concentration  while  writing. 

The  second  major  problem  with  the  word  processing  treatment 
was  the  disruptive  nature  of  the  accessing  the  hardware  necessary*. 
In  this  school  environment,  all  of  the  school's  computers  are  grouped 
into  two  laboratories.  Although  ready  access  was  not  a  problem 
during  the  period  of  time  required  for  the  study,  each  trip  to  the 
computer  lab  seemed  to  be  a  "mini  field-trip." 

several  students  stated  that  they  preferred  remaining  In  class 
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working,  rather  than  the  disruption  of  relocating  in  the  computer  lab. 
In  addition,  other  students  said  that  they  often  purposefully  wasted 
time  during  the  required  transitional  periods. 

Finally,  several  students  in  the  word  processing  group  noted 
that  they  often  neglected  the  careful  planning  that  they  would  have 
ordinarily  performed  prior  to  actually  composing  the  draft.  The 
attributed  this  neglect  to  their  impressior^  that  the  word  processor 
simplified  editing  to  such  an  extent  that  planning  was  no  longer  as 
important  as  it  had  been  with  conventional  paper  and  pencil  writing. 
One  student  noted  that  the  consequences  of  poor  planning  while  using 
the  word  processor  were  not  a  severe  since  "with  computer,  so  what 
if  you  have  to  start  over?" 

Although  this  study  demonstrated  that  word  processing  has  the 
potential  to  provide  an  instructional  environment  that  can  be 
beneficial  to  the  writing  skills  of  low  achieving  learners,  several 
important  questions  remain  and  further  research  should  be  conducted. 

Future  scudies  should  investigate  three  Issues  concerning  the 
instructional  uses  of  word  processing.  First,  an  appropriate  mode  of 
providing  basic  keyboard5ng  skills  should  be  investigated.  Perhaps  an 
introductory  module  on  keyboarding  should  be  provided  to  all  the 
students  in  a  manner  analguous  to  basic  handwriting  skills.  Clearly, 
the  lack  of  these  skills  is  a  serious  impediment  to  developing  writing 
skills  with  the  word  processor. 

Second,  varied  hardware  configurations  should  be  examined  In 
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order  to  find  the  b<  Jing  mode  In  which  the  type  of  distractions 
observed  In  this  study  might  be  minimized.  For  example,  potential 
solutions  Including  using  a  dedicated  computer  classroom  should  be 
investigated.  '  •  jny  event,  the  disruptive  arranr  nents  encountered 
during  this  studied  should  be  minimized  to  the  extent  possible. 

Finally,  future  studies  should  determine  ways  In  which 
outlining  and  other  pre-wrlting  activities  can  be  emphasized,  along 
with  the  re-writing  and  editing  phases  of  the  writing  process.  There 
are  several  relatively  new  computer-assisted  proj<;ct  planning 
programs  that  are  available.  Perhaps  such  a  package  might  provide  a 
suitable  method  with  which  planning  skills  might  be  developed. 

In  summary,  the  results  of  this  study  suggest  that,  with  the 
exception  of  several  significant  logistical  problems  associated  with 
the  Implementation  of  the  computers  themselves,  word  processing 
technology,  because  of  Its  ability  to  greatly  simplify  the  re-writing 
phase,  may  provide  the  Ideal  medium  for  the  development  of  holllstic 
writing  skills  fc.''  many  learners. 
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Table  i.  Writing  sample  cell  means  in  percent 


Word  Processing        Control  TOTAL 


Jr-77.13  ^-73.00  r- 77.56 

High  s-  lO.i:  s-  8.85  9.35 

(n=i6.)  (n=16)  (n-32) 


X  -  7425  X"  -  67.88  JT  -  7 1  .Ou 

Low  s=  7.86  s=  7.71  s=  8.32 

(n-:G)  (n-*u)  (n  =  32) 


X  - 75.69  JT- 72.94  jr-7431 

TOTAL        s«  9.02  s-  9.65  s=  9.37 

(n  =  32)  (n  =  32)  (n  =  64) 
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Table  2.  Analysis  of  variance  for  the  writing  sample. 


Source 

SS 

df 

MS 

F 

Achlevemeiit  (A) 

676 

1 

676 

8.963 

Treatment  (T) 

121 

1 

121 

1.60 

AxT 

210.25 

1 

210.25 

2.79^ 

Within  (error) 

4527.50 

60 

75.46 

3.001  <p<.01 
^.05<p<.J0 
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Figure  Captions 

Ficure  1.     The  writing  process  including  pre-writing,  writing,  and 
re-writing. 

Figure  2.     Achievement  by  Treatment  Interaction  for  the  writing 
sample. 
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A  COMPREHENSIVE  STUDY  OF  THE  OPERATIONAL  PROBLEMS  OF  HIGHER  EDUCATION 
AFFILIATED  CABLE  TELEVISION  STATIONS 


For  the  past  40  years  tflfvi'jion  has  bttn  primarMy  delivtred  by  a  limiting 
open-air  broadcasting  medium.    The  steady  establishment  of  cabl7  television 
Mithin  communities,  recent  technological  developmentt  in  cable  carrying 
capacity,  and  the  loosening  of  FCC  regulations  have  all  fostered  the  potential 
for  rapid  cable  growth  and  utilization.    Ulth  increasing  market  penetration, 
many  colleges  and  universities  have  or  will  affiliate  with  !oca1  or  regional 
cable  systems  providing  a  mutually  beneficial  relationship  for  training, 
programming,  and  public  access. 

The  purpose  of  the  presentation  will  be  to  report  upon  %  selective  and 
intensive'survey  which  focused  upon  documenting  and  identifying  operational 
problems  these  affiliated  stations  are  having  in  Accomplishing  their  respectiuA 
missions.    Results  from  the  study  will  help  in  providing  an  understanding  of  the 
current  range  of  operations  and  issist  other  colleges  and  universities  to 
examine  this  option  in  television  and  education. 

The  primary  areas  of  interest  consisted  of  st/tion:  (1)  organization;  (2) 
budget;  <3)  personnel;  and  (4)  equipment. 

The  paper  will  concentrate  on  the  most  significant  problems  identified 
given  the  four  primary  areas  of  interest.    The  paper  will  also  provide 
recontfiendat io*^    that  may  be  used  by  higher  education  insti       rns  that  are 
considering  developing  a  cable  facility  and  those  existing  .  icilities  looking 
for  ways  to  improve. 


A  COMPREHkNSIVE  S^UDY  OF  THE  OPERATIONAL  PROBLEMS  OF  HIGHER  EDUCATION 
iFFILIATEO  CABLE  TELEVISION  STATIONS 


For  the  past  40  years,  television  has  been  :)rima'^i1x  a  broadcasting  medium. 
Signals  were  t;^ansmitted  from  antennas  located  on  towers  and  picked  up  by  hor^e 
antennas.    This  system  limits  the  amount  of  channels  that  can  be  broadcast  due 
to  overlapping  anu  i  iterference .    Nearly  one-half  of  the  U.8,  television 
audience  cannot  receive  more  than  six  broadcast  channels;  many  receive  less  and 
the  picture  quality  is  inferior  on  many  of  the  channels  (Smith,  1979). 

However,  cable  television  has  the  potential  to  end  the  scarcity  of 
channels.    Many  existing  cable  systems  carry  20  television  channels  and  some  up 
to  40  (Uilliams,  1982).    Fiber  optics  developed  at  Bell  Research  Labs  make 
possible  a  greatly  increased  channel  capacity,  numbering  into  the  thousands  of 
chann^^s  (Bittner,  1981). 

Further  cable  growth  has  been  fostered  by  the  elimination  of  some  FCC 
regulations  in  1978  by  the  courts  (Levenson,  1980; .    Estimatf     H  cable  growth 
€^e  that  50/<  of  about  95  million  projected  households  in  1995  will  be  purchasing 
cable  services.    In  the  early  1980^s,  cable  penetration  is  a  little  over  20^.  of 
77  million  households  (Uilliams,  1982). 

Many  colleges  and  universities  have  television  studios  and  often  they  are 
aff i 1 iated  wi th  local  cable  systems.    These  studios  have  several  purposes  with 
the  most  important  being  the  instruction  and  training  of  students.  However, 
many  of  these  studios  also  provide  public  access  for  the  community  to  the  local 
cabU  company^^i  channels.    A  study  is  needed  to  d<»termine  what  problems  ^hese 
studios  are  having  in  accomplishing  their  mission.    Such  a  stud/  wuuld  be  a  help 
in  providing  an  understanding  of  the  services  available  and  assisting  other 
colleges  to  examine  the  option  in  television  and  education. 


This  study  win  focus  on  examining  college  and  university  affiliated  cable 
television  stations  and  the  identification  of  their  oper^.tional  problems. 

Tie  pur;)Ose  of  this  study  is  to  present  data  on  p>^cb1ems  and  concerns  that 
a  college  should  consider  before  starting  a  cable  afiil iated  station. 

There  are  four  research  questions  that  wil!  be  examined  by  the  study. 
These  questions  will  center  around  four  arfas;  organization,  budget,  personnel, 
and  eqjipment.    The  four  research  questions  to  be  answered  are: 

1.  Uhat  orgcinizational  concerns  can  be  id<rntified  in  college  and  university 
cable  affiliated  stations? 

2.  Uhat  budget  concerns  can  be  identified  in  college/university  cable 
aff i 1 iated  stations? 

J.    Uhat  personnel  concerns  can  be  identified  in  collige  and  uniuersity 
a^f i 1 iateb  stations? 

4.    i4hat  equipment  concerns  ccn  be  identified  in  college/university  cable 
aff i 1 iated  stations? 
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Nintty-two  directors  or  chit^f  txtcutivts  of  .lightr  tducation  iffiliittd 
cablf  staiiont  wtrt  surveytd.    A  devtloptd  qutfttionniirt  consisting  of  ovtr  100 
idtntififd  variablts,  clusttrtd  undtr  tht  four  primiry  irtis  of  inttrtst,  *»rvtd 
as  a  controllfd  protocol  for  tht  20  to  30  minutes  in-dtpth  ttUphont  inttrvitws. 
The  majority  of  tht  questions  rtqutsttd  a  rtartion  to  a  stats^ratnt  along  a 
ualue-cont inuum  scalt.    Tht  (.rotocol  also  provided  tht  opportunity  for 
optn-fndfd  cofmtntary  which  was  Uttr  synthtsiztd  givtn  id^ntif itd  patterns. 

Th»  consuming  mtthod  of  ttltphont  interviews  proved  invaluable,  resulting 
in  information  not  readily  attainable^  through  other  research  methods.  The  lOO'A 
participation,  frankness,  and  enthusiastic  support  of  tfiis  research  efiurt  by 
those  interviewed  became  rapidily  apparent  given  the  unique  foccs  of  this  surv<^y 
-  on  cable  systems  ^lone.    For  an  »r"'epth  report  on  the  methodology  4nd  a  copy 
of  the  final  questionnaire  used  in  this  study  see  Dudt  and  Lamberski,  1986. 


Analysts  of  DemooraDhic  Information 

The  survey  gathered  information  from  87  college-  and  university-  affiliated 
cable  stations  across  the  United  States.    There  were  23  private  colleges  and 
universities  and  64  public  colleges  and  universities. 

The  size  of  the  institutions  of  higher  education  surveyed  varied  a  gre&t 
deal.    The  smallest  college  had  an  undergraduate  student  enrollment  of  780 
students  and  the  largest  university  had  65,000  undergraduate  students. 

The  graduate  enrollments  of  the  surveyed  institutions  varied  also. 
Twenty-six  of  the  colleges/universities  did  not  offer  graduate  education  at  all 
while  one  university  had  10,000  graduate  students. 

A  slight  majority  of  the  colleges  and  universities  surveyed  had  ongoing 
continuing  education  programs,  46  or  52.9^.    However,  there  were  37  institutions 
that  housed  cable  facilities  that  could  not  answer  the  question.  These 
directors  did  not  know  if  their  institution  provided  continuing  education. 

During  the  discussion  on  continuing  education  (non-credit  adult  education) 
with  the  directors,  it  was  noted  that  only  one  director  was  using  the  station 
for  non-credit  adult  education.    The  37  directors  that  did  not  answer  the 
question  were  totally  unaware  of  th*ir  institutions  efforts  in  this  area. 

The  institutions  were  divided  into  three  demographic  areas{  urban,  suburban 
and  rural.    An  urban  institution  was  defined  as  an  institution  that  was  located 
within  the  City  limits  of  a  major  metropolitan  center  of  50,000  or  more  peor 
A  suburban  institutio;i  was  located  within  a  one-hour  drive  of  a  major 
metropolitan  center,  a  rural  insUtution  %4as  more  than  a  une-hour  drive  from  a 
major  metropolitan  center.    The  majority  of  the  institutions,  49  or  56. 3X,  were 
located  in  rural  areas. 

There  is  a  great  variation  in  the  age  of  the  higher  education  affiliated 
television  stations;  one  station  was  founded  in  1957  and  the  late  in  1984. 
There  was  a  growth  throughout  thr  I960'-:  and  1970's  with  continual  but  slc?wer 
growth  in  the  1980's. 

Thirteen  facility  directors  were  unable  to  establish  when  their  stations 
began.    Several  of  the  directors  were  new  to  their  positions  and  some  said  that 
there  had  been  ^o  much  staff  turnover  over  the  years  that  the  date  had  been 
lost. 

Generally,  it  takes  four  y^ars  once  a  station  ha^  been  founded  to  become 
aff  il  iated  with  a  cable  company.    The  earliest  date  for  ca»)le  affiliation  was 
found  to  be  19^6,  according  to  the  directors  surveyed,  with  the  latest 
affiliation  being  January  of  1985.    There  were  only  four  directors  ^hat  were 
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unabU  to  idfntifx  when  thtir  stations  btcamt  a^ff  il  iattd  with  tht  cable  conipanx. 

Programming  of  tht  vast  majority  <97/)  oi  tht  hightr  tducation  affiliattd 
cablf  stations  is  part  of  tht  basic  cablt  ftt •    In  othtr  words,  individuals 
within  tht  cnmmunitx  rtctiving  cablt  do  not  gtntrall/  havt  to  pax  txtra  to  gtt 
the  colltgt's/uni vtrsi ty's  cablt  station.    Thtrt  wtrt  only  six 
colltgts/univtrsi tits  whost  programming  was  net  included  within  tht  basic  cablt 
ftt. 

Tht  basic  cablt  ftt  varitd  for  W  to  $23  for  cablt  strvict  (all  dollar 
figurts  wtrt  rounded  to  tht  ntartst  dollar).    Twtnty-fiut  of  tht  dirtctors  or 
2Q.TA  did  not  KnoM  what  tht  basic  cablt  ftt  was  in  tht  comnivnity  whtrt  thtir 
programming  was  prtstnttd  to  tht  public.    It  is  important  to  nott  that  not  all 
programming  dtvtloptd  by  a  col  1 tgt/uni vtrsi ty  is  prtstntid  cn  tht  local  cablt. 
If  tn«rt  was  no  local  cablt  company,  ofttn  tht  programs  wtrv  carried  by  a  ..tarby 
company  in  another  town  or  city.    This  helps  explain  why  the  directors  were 
unfamiliar  with  the  price  system  of  the  cable  company. 

There  were  only  six  surveyed  facilities  that  had  programming  whose  cos^s 
were  not  included  in  the  basic  cable  fee.     Only  one  director  knew  what  the 
additional  fee  was  for  ...»  programming.    His  cable  company^s  b^sic  fee  was  $10 
to  get  the  pay  teUvision  channel  that  carried  the  facility's  programming.  The 
other  five  directors  had  their  programming  on  pay  television  channels  but  did 
not  know  what  tht  consumer's  fee  was  to  obtain  the  programming. 

The  population  of  the  communities  that  could  potentially  receive  the 
surveyed  facilities  programming  varied  greatly,  ranging  from  the  smallest  at  900 
to  the  largest  at  1.5  million.    There  were  22  directors  that  did  not  knu 
accurately  their  community's  population. 

A  large  n,ajo*^it/  of  the  directors  (72. 4X)  did  not  know  how  many  households 
were  getting  ciible  >iid  could  receive  their  facility's  programming.    The  24 
directors  that  did  know  generaKy  how  many  households  could  recei  e  their 
programming  gave  a  large  range  -.rom  200  households  to  170,0^0  households. 


Artal/ses  of  Station-related  Problems 
"Uhat  organizational  concerns  can  be  identified?" 

Problems  areas  in  instructional  programming,  reporting  relationships,  cable 
company  relationships  and  public  access  were  explored. 

The  most  serious  problem  fac^d  by  the  directors  in  providing  instructional 
programming  v^as  inadequate  funding.    Some  of  this  problem  was  caused  by  the 
general  lack  of  funds  i^  higher  education,  but  there  was  also  a  lack  of  faculty 
and  adtninistrative  support  for  the  effort  in  some  schools.    Several  directors 
related  that  their  administration  wanted  the  instructional  programming  but  were 
unwilling  or  unable  to  fund  the  efforts  at  the  proper  level.    Each  director  also 
stated  that  within  the  colleges  and  universities  there  was  a  minority  core  of 
faculty  members  that  were  against  televised  instruction.    It  's  interesting  to 
note  that  nowhere  did  unions  provide  insurmountable  problems  in  providing 
televised  instriction  or  telecourses. 

AMhough    hf  col  lege/jn  iversi  ty  administrators  gave  lip  service  to 
supporting  the  station's  programming,  they  did  r.ot  back  this  up  with  mone>  for 
equipment  and  personnel,    This  was  a  serious  problem  for  the  directors. 

Almost  all  of  the  stations  had  a  four-year  period  of  growth  and  adjustment 
before  they  became  aff il iated  with  a  local  cable  company.    This  allowed  for  a 
stabilization  of  staff  and  programming  bafore  raole  casting  was  begun. 

Although  the  stations  had  a  variety  of  adhiinistrat  ive  models,  there  wer^ 
ger<erall>  few  problems  in  day-to-day  management.    The  chain  of  comm-^nd  and  the 
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poMtr  structure  wert  not  usually  ptrcfivtd  as  a  probltm.    A  ftw  probltms  arosti 
hoMfutri  whtn  tht  sourct  of  iur\d\r\^  :on'f1ictfd  with  tht  day-to-day  workload. 
This  was  tsptcially  trut  when  tht  station  was  attached  to  an  academic  department 
and  the  station  received  its  funds  directly  from  the  administration  instead  of 
through  the  department. 

Generally  there  w^re  few  problems  in  the  higher  education  cable  stations 
relationship  w^th  the  cable  company.    Once  the  cable  channel  has  been  provided, 
most  cable  com^^^mies  have  a  'hands-of  r*  approach.    There  are  two  problems  that 
directors  warned  of:  one  —  do  not  share  the  channel  with  another  programming 
source  and  tWD       do  not  rely  on  the  cable  company  for  upgrading  or  maintenance 
of  equipment. 

Sharing  the  channel  with  another  programming  source  creates  problems  for 
the  higher  education  station  according  to  the  directors  and  very  few  still  hive 
a  shared  channel.    Sharing  the  channel  limits  the  station  on  when  it  can  program 
and  often  causes  a  very  uncomfortable  competitive  atmosphere.    If  the  shared 
programming  is  popular,  several  directors  stated,  then  the  local  public  asKed 
the  cable  company  to  provide  more  of  the  programming  and  less  of  the  collegers 
programming.    One  college  station  tost  its  channel  due  to  this  problem. 

Most  of  the  higher  education  affiliated  cable  stations  do  no  have  a 
functioning  advisory  board  even  though  there  is  an  advisory  board  *on  paper.* 
Most  of  the  directors  do  not  recognize  a  need  to  have  an  active  advisory  board. 

Unless  the  higher  education's  affiliated  station's  programming  is  popular 
in  the  cGmmunity,  the  cable  company  will  not  upgrade  equipment  or  provide  any 
type  of  maintenance.    Most  higher  education  directors  do  not  have  an  equipment 
or  maintenance  relationship  with  the  cable  company. 

Providing  public  access  to  the  community  is  not  generally  a  problem  for  the 
station.    Most  directors  believed  the  benefits  outweigh  the  problems.  Public 
access  affords  an  opportunity  to  provide  realistic  productions  and  programming 
experience  for  students. 


"Uhat  budget  concerns  can  be  identified?* 

Many  directors  Relieved  that  the  college/university  administrations  wanted 
the  station  to  provide  more  services  than  they  were  willing  ur  able  to  pay  for. 
Funding  is  a  problem  that  some  directors  were  unable  to  solve.    The  directors 
believed  that  they  had  a  constant  problem  in  educating  the  administration  on  the 
high  cost  of  television. 

Generally  speaking,  the  cable  companies  have  no,  or  r^^atively  few, 
financial  commitments  to  the  station.    The  service  that  the/  most  often  provide 
IS  wiring  and  the  transmission  of  the  station's  signal  to  the  head  end. 

Most  of  the  higher  education  affiliated  cable  stations  only  cable  cast  on 
the  local  cable  system.    Only  four  higher  education  facilities  had  developed 
linkage  with  other  cable  companies. 


"Uhat  fT^^onnel  concerns  c^tn  be  i dent i ied?* 

The  largest  problem  that  the  directors  faced  was  that  they  had  too  many 
additional  responsibilities  besides  the  station's  operations.    Many  directors 
were  also  teaching  faculty  members  and  were  given  a  one  course  teaching  load 
reduction.    Several  directors  stated  that  this  was  not  enough  of  a  reduced 
teaching  load.    Many  directors  also  complaine'l  that  there  were  not  enough 
professional  staff  to  o^^ersee  vhe  worl:  ^oad  and  this  created  a  heavy  reliance  on 
students.    The  reliance  on  students  also  caused  some  problems  getting  work  done 
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in  a  professional  and  timely  manner. 

The  heaux  time  demands  placed  on  the  directors^  also  caused  problems  with 
professional  development.    Several  directors  stated  that  they  were  not  current 
in  the  latest  developments  in  the  television  field.    Care  must  be  taken  by  these 
colleges/universities  to  ^revent  this  from  happening. 


''Ulhat  equipment  concerns  can  be  identified?" 

The  biggest  problem  ^hat  the  directors  had  was  a  lack  of  equipment.  The 
large  number  of  students  working  at  many  of  the  stations  created  a  need  for  more 
equipment  than  the  university  expected.    Common  equipment  components  that  were 
needed  were s    remote  equipment  (switches,  cameras,  lights)  and  more  editing 
f ac  i 1 i  t  ies. 

Irdiportant  components  were  often  missing  end  the  quality  was  not  at  a 
desired  level  for  many  directors.    Often  the  colleges/universities  bought  tlie 
equipment  that  they  believed  would  minimally  do  the  Job.    This  equipment  would 
then  prove  incapable  of  providing  the  technical  quality  expected.    There  was 
also  a  tendency  to  ngX  buy  new  'equipment  soon  enough  and  some  directors  were 
using  equipment  that  was  either  worn  out  or  outdated. 

A  lesser  equipment  problem  that  many  directors  faced  was  inadequate 
physical  plant.    Little  or  no  air  conditioning,  ]w  ')i1ings  or  high  noise 
levels  from  the  studio  were  common  problems. 


This  study  provides  information  th*t  may  be  used  by  higher  education 
institutions  that  are  considering  developing  a  cable  affiliated  facility  and 
those  existing  facilities  looking  for  ways  to  Improve.    Recommendations  1-3 
offer  suggestions  for  planning  and  5-iO  suggest  ways  to  developing  the  station. 

1.  A  newly  formed  higher  education  facility  should  not  immediately  become 
affiliated  with  a  cable  company.    Most  existing  facilities  took  four  years  from 
creation  to  cable  affiliation.    This  time  period  allows  the  station  staff  to 
develop  procedures,  personnel  and  gain  production  experience.    This  conflicts 
with  Zoglin  <198i)  who  believes  that  a  cable  channel  must  be  obtained  before 
higher  education  makes  a  commitment. 

2.  A  higher  education  affiliated  facility  should  have  complete  control  of  its 
channel.    This  channel  should  carry  only  programs  that  are  approved  by  the 
higher  education  institution.    This  action  will  ensure  the  station'^s  programming 
does  not  compete  with  programming  from  ?ther  profesional  sources.  Highly 
popular  commercial  entertainment  has  caused  at  least  two  stations  to  lose  their 
channel  to  hioher  rated  programs  when  the  genera;  public  asked  the  cable  company 
fcr  more  entertainment. 

3.  Create  a  functional  advisory  board  and  use  it  to  develop  a  clear  mission 
statement.    Clemens  (1980)  has  developed  clfar  purposes  for  the  advisory  board. 
Most  exis      g  stations  do  r\oi  use  advisory  boards  for  long-range  planning  or  to 
help  in  serving  the  major  problems.    This  involvement  of  the  community  can  help 
improve  tne  public  relations  of  the  college  (Clinton,  198it  Zoglin,  1981). 

4.  Devel'^p  a  close  relationship  with  the  college/university  adhnini  strati  on. 
Many  administrators  do  not  understand  the  complexities  of  television  and  its 
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production}  this  lack  of  unders tanr'^ng  ofttn  causes  a  lack  of  support.  Many 
dirtctors  also  btlitutd  that  thtir  facility  was  not  gttting  its  fair  shart  of 
fxisting  colUgt/univtrsi  ty  rtsourcts.    This  may  also  be  due  to  a  gentrtl 
unawartness  of  tht  potsibi 1 i t its  ttltuision  offers  (Carpenter-Huffman,  Kletter 
and  Yin,  1971). 

5.  Inuolue  other  facul ty  members  in  the  stations  operations.    This  increased 
inMoluement  by  higher  education  faculty  benefits  both  the  faculty  and  the 
station.    Faculty  benefit  by  having  an  outlet  for  research  (Kichi,  1979)  and  an 
avenue  for  public  service  (Clinton,  1981).    The  higher  education  station 
benefits  by  the  energy  and  input  of  the  faculty  members. 

6.  Develop  linkages  with  ether  nearby  cable  companies.    This  would  expand  the 
infulence  of  the  station  and  the  college/university.    Few  of  the  facilities 
surveyed  where  programming  on  more  than  one  cable  system.    According  to  Zoglin 
(19B1),  this  might  create  tension  with  the  cable  company}  however,  this 
researcher  does  not  agree.    Most  cable  companies  do  not  have  ^  large  comm i  treen  t 
to  the  college  cable  station  and  its  programming.    This  finding  agrees  with 
Comanor  andMichell,  (1971). 

7.  Purchase  the  best  quality  equipment  possible.    The  cable  station  will  be  on 
the  dial  with  commercial  stations  and  noticably  poorer  t*^chnical  quality  will 
hurt  the  stations  professional  image.    Audiences  expect  quality  production 
(Brown,  1973j  Turek,  1979)  and  the  college/university  must  make  this  commitment 
to  be  successful . 

8.  The  college/university  should  hire  a  full-time  director.    Currently,  the 
station  directors  are  forced  to  wear  too  many  hats;  teachers,  administrators  and 
production  coordinators.    This  has  led  to  staff  turnover,  a  heavy  reliance  on 
students  ahd  inadequate  ongoing  professional  staff  development.    Most  directors 
are  now  working  on  one  half  or  one  quarter  release  time  from  other  duties. 
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A  HETHODOLOGY  IN  STUDYING  HIGHER  EDUCATION 
AFFILIATED  CABLE  TELEVISION  STATIONS 


Abstract 


The  purpose  o-f  this  paper  is  two  fold.    First,  to  present  a  developed 
methodological  approach  fcr  the  stud/  oi  cable  television  stations  affiliated 
with  hiyher  education  institutions;  and  second,  to  present  the  signf icant 
findings  detailing  the  operational  problems  of  higher  education  affiliated  cable 
television  stations. 

The  paper  will  highlight  an  extensive  literature  search  and  a  resulting 
conceptual  framework  utilized  throughout  the  investigation.    The  literature 
search  helped  identify  over  100  variables.    The  conceptual  framework  deve1op«?d 
identified  and  clustered  critical  issueu  of  concern  on  the  operations  of  cable 
television  stations.    Variables  were  clustered  under  the  four  primary  areas  of 
interest:  <1)  organization;  <2>  budget;  (3)  personnel;  and  <4)  equipment. 

A  constructed  questionnaire  which  addressed  this  conceptual  framework 
provided  the  guided  protocol  used  during  the  20  to  30  minute  telephone 
interviews.    Ninety-two  directors  or  chief  executives  of  higher  education 
affiliated  cable  stations  were  surve'^ed. 

Internal  and  external  validity  of  the  questionnaire  was  controlled  in  part 
by  extensive  pre-study  screening  by  professional  reviewers.  Subsequent 
in«»trument  revisions  allowed  for  a  majority  of  questions  to  be  presented  as  a 
statement  to  which  a  reaction  along  a  value-continuum  scale  would  be  offered. 
The  instrument  also  provided  the  opportunity  for  open-ended  statements  which 
were  analyzed  post-hoc  given  perceived  patterns. 

The  investigators  wi n  identify  strategies  and  techniques  utilized  in  the 
development  of  the  questionnaire  protocol.    The  consuming  telephone  survey 
method  will  be  discussed  in  terms  of  resuits  and  impact  not  readily  attainable 
through  other  research  methods. 

Discussion  of  the  research  findings  will  focus  upon  the  four  major  areas  of 
interest.  Data  summaries  will  be  presented  concentrating  on  the  most  signf icant 
problems  identified. 
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Background 

For  the  past  40  years,  television  has  been  primarily  a  broadcasting  medium. 
Signals  were  transmitted  from  antennas  located  on  towers  and  picked  up  by  home 
antennas.    This  system  limits  the  amount  oi  channels  that  can  be  broadcast  due 
to  overlapping  and  interference. 

However,  cable  television  has  the  potv       A  to  end  the  scarcity  oi 
channf^ls.    Many  existing  cable  systems  carr.   ^0  television  channels  and  some  up 
to  40  (Uilliamns,  1982).    Fiber  optics  developed  at  Bell  Research  Labs  make 
possible  a  greatly  increased  channel  capacity,  nuiTibering  into  the  thousands  oi 
channels  (Bittner,  1981).    Further  cable  growth  his  been  fostered  by  the 
elimination  of  some  FCC  regulations  in  1978  by  the  courses  (Levenson,  1980). 

Many  colleges  and  universities  have  television  studios  and  often  they  are 
affiliated  with  local  cable  systems.    These  studios  have  several  purposes  with 
the  most  important  being  the  instruction  and  training  jf  students.  However, 
many  of  these  studios  also  provide  public  access  for  the  comn^unity  to  the  local 
cable  company^'s  channels.    A  study  is  needed  to  detef^rmne  what  problems  these 
studios  are  having  in  accomplishing  their  mission.    Such  a  study  would  be  a  help 
in  providing  an  understanding  of  the  services  avarlable  and  assisting  other 
co^^eges  to  examine  the  option  in  television  and  education. 


Purpose 

This  study  will  focus  on  examining  college  and  university  af f i 1 i ated  cabi e 
television  stations  and  the  identification  of  their  operational  problems. 

The  purpose  of  this  study  is  to  present  data  on  problems  and  concerns  that 
a  college  should  consider  before  starting  a  cable  affiliated  station. 

There  are  four  research  questions  that  will  be  examined  by  the  study.  These 
questions    will  center  around  four  areas;  organization;  budget;  personnel;  and, 
equipment.    The  four  research  questions  to  be  answered  ares 

li    What  organizational  concerns  can  be  identified  in  college  and  university 
cable  affiliated  stations? 

2.  What  budget  concerns  can  be  identified  in  college/university  cable 
af f  i 1 iated  stations? 

3.  I'^hat  personnel  concerns  can  be  identified  in  college  and  university 
concerns  affiliated  stations? 

4.  What  equipment  concerns  can  be  identified  in  college/university  cable 
af f  i  1  i  ated  stations'^ 


Methodology 

Content  Analysis 

The  purpose  of  this  study  was  to  gather  data  on  the  operatina!  problems^  of 
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college  and  uniuersity  atfiliattd  cable  television  stations*    Survex  research 
Mas  utilijed  to  gather  the  information  as  Sabbie  (1973)  stated  that  survey 
research  is  useful  in  discovering  the  distribution  of  certain  traits  or 
attributes.    A  descriptive  survey  was  used,  which  according  to  Isaac  and  Micheal 
(1979)9  Mill  collect  data  systematically  to  describe  a  situation  or  area  of 
interest  factually  and  accurately. 

The  method  for  data  collection  was  telephone  interviews.    This  method  of 
collecting  data  was  chosen  due  to  very  poor  response  rate  to  the  initial  pilot 
mailing.    Out  of  20  questionnaires  distributed  as  a  pilot  test»  only  four  were 
returned.    An  alternative  method  of  collecting  data,  telephone  interviews,  was 
therefore  selected. 

The  total  identifiable  population  was  92  directors.    These  facilities  were 
identif  ed  from  two  sources:  TV  Guide  Almanacs  and  the  Journalism  Directory 


The  following  professional  organizations  w^re  also  contacted  in  an 
unsuccessful  effort  to  identify  more  facilities;  A^  ha  Epsilon  Rho;  the 
Association  of  Educational  Communications  and  Tec^  ology;  the  Broadcast 
Education  Association;    and  the  National  Cable  T^iwvision  Association. 

It  was  also  felt  that  the  highest  response  rate  would  be  obtained  by 
telephone  interviews.    This  proved  correct  as  87  of  the  92  directors  that  were 
in  charge  of  facilities  were  interviewed.    ThuS|  the  response  ra^ >  was  94. SX. 
Participation  was  further  encouraged  in  the  promise  that  results  would  be  sent 
to  each  director. 

Procedures 

Eighty-seven  of  the  92  directors  of  higher  education  affiliated  cable 
stations  across  the  United  States  were  interviewed.    Telephone  interviews 
ensured  that  the  correct  person  answered  the  questions  and  provided  an 
opportunity  of  immediate  clarification.    Station  listings  in  TV  Guide  Almanac 
and  the  Journalism  Directory  1983  were  useful  in  identifying  facilities  but 
contained  may  errors  when  identifying  the  appropriate  director.    Some  facilities 
had  temporary  or  revolving  directors  making  it  more  difficult  to  identify  who 
lyaas  in  charge  at  the  prosent  time.    The  secretary  that  answered  the  telephone 
was  always  able  to  give  accurately  and  quickly  the  director's  name.  Often 
several  telephone  calls  were  necessary  to  estabWh  an  appointment  to  do  the 
interv  iew. 

The  interviews  were  conducted  during  the  months  of  November  and  December  of 
1984.  Each  interview  took  an  average  of  20  minutes  with  a  few  taking  as  lonp  as 
a  half  hour. 

The  interview  took  the  following  format.    First,  the  interviewer  would  give 
some  background  information  on  the  project  and  the  purpose  of  the  research. 
Secondly,  the  interviewer  would  explain  the  questionnaire  and  its  format.  This 
would  take  one  or  two  minutes  afte^  which  the  interviewer  would  proceed  through 
the  questionnaire  one  question  at  a  time  untii  all  the  questions  were  completed. 
AM  directors  were  encouraged  to  volunteer  infromation  that  was  not  covered  by 
the  questions.    Few  took  the  opportunity  to  provide  any  additional  comments  as 
most  see.   d  to  believe  that  the  answer  choices  provided  by  the  questionnaire 
were  satisfactory  as  to  scope. 

Instrument  Development 

Before  constructing  the  questionnaire,  informational  interviews  and 
di'-wUssions  with  various  professionals  associated  with  the  cable  television 
industry  and  higher  education  were  held.    These  discussions  led  to  the 
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development  of  «  preliminary  questionnaire  that  was  validated  by  a  team  of 
experts.    The  validators  were  each  sent  a  draft  of  a  questionnaire  and  were 
asked  to  respond  to  any  inconsistencies  or  ommissions.    There  were  also 
follow-up  interviews  wi th  the  validators  that  focused  on  criticisms  of  the 
instrument  in  order  to  more  fully  redefine  the  questionnaire. 

The  validatiors  were  chosen  carefully  in  order  to  provide  input  that  was 
not  only  broad  in  scope  but  also  specialized.    All  validators  had  a  broad 
background  in  television,  higher  education  and  were  able  to  bring  unique  talents 
that  were  neeeded  to  develop  the  questionnaire.    The  validatiors  were  also  used 
as  a  pilot  test.    This  w;;«  helpful  in  perfecting  the  interview  technique  before 
the  other  directors  were  interviewed. 

Quest  ionnaire 

The  survey  questionnaire  is  divided  into  two  parts|  a  copy  o-l  the  complete 
questionnaire  is  provided  in  the  Appendix.    The  first  part  helps  identify  some 
demographic  information  about  the  cable  station.    The  second  part  requests 
specific  information  concerning  the  station  and  related  problems  based  upon  the 
primary  research  questions. 

Data  Analysis 

The  data  obtained  from  87  completed  interviews  were  coded  and  entered  into 
the  SPSS  (Statistical  Package  for  the  Social  Sciences)  program  housed  in  the 
Honeywell  level  66  computer  at  the  Indiana  University  of  Pennsylvainia.  There 
were  106  questions  with  1S|322  data  points  for  this  research  project. 

Several  types  of  statistical  data  were  obtained  upon  analysis.    There  were 
frequency  counts  for  ^11  answers,  adjusted  for  missing  data.    Occassional 1y 
there  were  questions  that  the  directors  were  unable  or  unwilling  to  ansi^er, 
resulting  in  missing  data. 

Exploratory  analysis  of  data  revealed  trends,  identified  problems,  and 
exposed  areas  of  further  research. 


This  investigation  examined  data  obtained  form  telepnone  interviews  to  87 
higher  education  affiliated  cable  television  stations.    The  comprehencsi ve  study 
focused  upon  the  primary  areas  of  interest:    I.  Organization;  II.  Budget}  III. 
Personnel;  and,  IV.  Equipment. 

The  following  outlined  summar>  of  the  major  findings  is  not  presented  in 
'^ank  order;  rather,  highlighted  issues  or  statements  are  provided  within  these 
primary  areas  of  interest. 

I.    ORGANIZATIONAL  PROBLEMS/STATEMENTS 

a.  The  data  indicate    a  consistent  f indinc  of  inadequate  funding  by  most 
colleges  and  universities.    The  areas  of  equipment  and  personnel  were  most 
typically  cited. 

b.  Most  local  cable  companies  do  not  intervene  in  the  day  to  day 
operations  of  the  station. 

c.  Most  affiliated  stations  Jo  share  the  provided  cable  channel  with 
another  prgramming  source.    The  affiliated  station  is  the  sole  source  of 
programrDing  for  a  provided  channel. 

d.  Stations  which  have  advisory  boards  perceive  those  boards  as  being 
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inactivt  or  having  a  Im  Itvtl  oi  activity.    Relattd  to  this  finding,  most 
station  dirtctors  do  not  recognize  a  need  "for  a  more  active  board, 
e.    Most  station  directors  believe  that  providing  or  doing  public  access 
programming  benefits  the  overall  operation  oi  the  cable  station. 

1 1 .    "BUDGET  PROBLEMS/STATEMENTS 

a.  Higher  education  administrators  want  and  demand  that  the  station 
provide  more  services  than  the  administration  is  willing  or  able  to  provide 
budgetary  support  for. 

b.  Linkages  with  other  cable  systeniSi  for  programming  acquisitions  or  for 
program  delivery,  were  not  evident.    Related  to  this  finding,  there  appears 
to  be  a  limited  return  on  investment. 

c.  Overwhelmingly,  there  does  fiot  seem  to  be  a  financial  commitment  from 
the  cable  company. 

in.    PERSONNEL  PROBLEMS/STATEMENTS 

a.  Most  ttation  directory's  time  is  divided  among  other  institutional 
responsibilities  apart  form  direct  station  management.    Related  to  tins, 
most  director's  perceive  that  they  are  not  given  sufficient  rf'lease  time 
for  station  duties. 

b.  Most  stations  are  highly  dependent  upon  student  assistants.    Given  9 
predominantly  student  work  force,  programming  and  general  studio  work/lasks 
are  not  preformed  in  a  timely  or  professionally  consistant  manner. 

c.  There  appears  to  be  inadequate,  ongoing,  professional  development  for 
station  directors. 

IV.    EQUIPMENT  PROBLEMS/GTATEMENTS 

a.  The  data  revealed  that  there  is  a  consistent  pattern  of  ovenit i 1 izat i on 
of  equipment  and  a  general  feeling  of  insuffi   'ent  stock  of  equipment. 
This  is  especially  evident  given  the  numbers  of  students  involved  at  most 
stations. 

b.  A  consistent  finding  was  the  statement  by  station  directors  of  the 
inadequacy  of  their  current  physical  plant.    This  was  particularly 
emphasized  given  the  rapid  growth  of  programmatic  needs  and  advancements  in 
technology. 

c.  Current  equipment  or  projected  patterns  of  equipment  purchasing  is 
perceived  to  be  below  desired  levels  of  quantity  and  particularly  quality. 

d.  There  appears  to  be  little  or  no  strategic  planning  for  equipment 
update.    In  most  cases  equipment  must  be  expensively  maintained  beyond  its 
useful  service  1 ife. 


In  summary,  the  findings  indicate  specific  problems  and  issues  which  most 
higher  education  affiliated  cable  television  stations  must  deal  with.  These 
problems  and  issues  appear  consistent  across  different  sponsoring  institutions 
and  across  station  structure  or  size. 
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A  PROFILB  ON  CURRENT  PROBLEM B  OF 
COLLEGE  AND  UNIVERSITY  CABLE  AFFILIATED  TELEVISION  STATIONS 

The  purpose  of  this  questi-wnaire  is  to  collect  data  on  the  status  and  problews  of  college  and  university 
affiliated  cable  television  stations. 

WHO  SHOULD  BE  COHPLETINB  THIS  QUESTIOWftlRg? 

The  Director,  Coordinator,  or  day-to-day  administrator  of  the  cable  station.   By  catle  fetation  we  mean  a  facility 
that  provides  cablecasting  to  the  college  or  university  and  the  'rowmjnity. 

FOBMftT  OF  THE  QUESTICiUftlRE 

The  questionnaire  is  broken  into  two  parts.  The  first  part  hetps  identify  some  general  demographtc 
information  about  the  cable  station.  The  second  part  requests  some  specific  information  concerning  the  station  and 
related  problems.   It  also  contains  an  opportunity  for  sharing  some  specifics  not  highlighted  within  this 
questionnaire. 

It  would  ^e  most  beneficiai  if  you  answer  ali  the  questions  and  statements  as  best  you  can.  You  should 
proceed  through  the  questionnaire  in  order  from  beginning  to  end.  The  questionnaire  has  been  designed  to  not  only 
solicit  information  from  you,  but  also  to  provide  a  common  base  of  knowledge  and  sharing  as  you  work  through  ;he 
questionnaire. 

SURVEY  PARTICIPATION  fiND  SHftRlNS  OF  RESULTS 

tts  part  of  the  study,  the  principal  investigator  is  willing  to  provide  you  a  suniroary  copy  of  the  results  should  you 
desire  to  receive  a  copy. 

Do  /ou  t-ish  to  receive  a  copy  of  the  results  (check)?  ^Yes  ^Mo 

If  yes,  please  print  or  type  this  identification  information- 
Name:      

(DrIMrlMs)        (First)        (M.I.)  (Last) 
Titles  

Contact   ^^^Z^^^^ZI^ZZ^^ZZ^^^ZZ^Z^Z^ 

Address: 


(City)  (State)  (Zip  code) 

Office  Phone:  (  )  -  


PART    I    -   GENERAL   DEMOGRAPHIC  INFORMATION 

1. Complete  name  of  coPege  or  university:  


2. Please  check  which  \^  applicable  about  your  institution:  private   public 

3. Overall  enrollment  (estimated):   undergraduate   graduate 

Does  your  institution  have  continuing  education  (check):  Yes  No 

If  yes:  What  is  the  appproximate  enrollment  

4. Setting  or  location  characteristics  of  the  institution.  Check  one- 

 urban  (within  the  city  limits  of  a  major  metropol itian  center,  50,000  people) 

 suburban  (within  one  hour  driving  distance  of  a  major  metropol  itian  center) 

 rural  (having  no  major  metropol itian  centers  within  a  one  hour  driving  distance) 
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5.  Fi11-in  tht  rtqutsted  infornation: 

The  year  cable  station  mis  founded:  

The  year  station  became  aff 11 iated  with  a  rable  company:  

Is  your  station  programming  part  of  the  basic  cable  fee  (check  &  answer)- 
 ^Yes  Ho 

If  yts,  what  is  the  total  mcnthy  fee  paid  by  subscribers.  ♦  

If  no,  what  is  the  base  monthy  fee  ♦  

and  what  is  the  additional  fee  for  your  station's  programming,  i  

6.  Uhat  IS  the  number  of  cable  subscribers  that 

-can  receive  your  stations  programming  (potential):  

-are  receiving  your  stations  prosramming  (actual):  

7.  Check  one  of  the  appropriate  statements  on  channel  reception: 

 ^Your  station  is  received  on  one  of  th5  first  12  primary  channels. 

 ^Your  station  is  received  on  a  channel  number  greater  than  13. 

8.  List  the  professional  organization,  or  associations  that  the  tel  .'Vision  staff  and  or  the  station  are  members  of: 

Please  check:  Individual  Station 


PART    II    -  ASSESSMENT   OF  s 

ORGANIZATION,    BUDGET,    PERSONNEi- ■    AND  EQUIPMENT 

ORQANIZATION^  BUDGET.  PERSONNEL.  AND  EQUIPMENT 
Section  (A)  -  Description  of  the  organization. 

1.  What  IS  the  mission  of  the  station.   Please  indicate  an  estimated  percentage  given  the  below  list  of 
probable  station  missions;  space  has  been  permitted  should  additional  missions  need  to  be  added. 

 Vn  instruction  of  students  in  cable  technology 

 Yb  Delivery  of  educational  programming  in  support  of 

institutional  offerings 

 Marketing  or  public  relations  for  the  institution 

 Delivery  of  programming  in  support  of  community  affairs 

 Y  Other:  

 y.  Other:  

100  y.  Total 

2.  Please  check  im  of  the  below  areas  which  describe  the  type  of  instructional  progranvnir.g  you  may  air. 

 offering  of  telecourses 

 development  of  supplemental  student  materials  with  your  programming 

 offering  of  tutorial  or  remedial  programming 

 capacity  for  live  coverage,  such  as  quest  speakers  or  special  events 

 enrichment  programming,  such  as  cultural  events 

 other :  

 other :  
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3. Below  is  a  list  oi  problem  areas  in  instructional  programing-   Circle  your  fee',  ings  as  to  the  significance 
of  these  problems  given  your  station.  Add  any  conmtnts  for  clarification  of  your  responses 
(optional-sptcify). 
0-no  problem 

 5ga  serious  problem 

0  1  2  3  4  5  lack  of  or  no  faculty  support 
specify: 

0  1  2  3  4  5  lactt  of  or  no  adhinistrati ve  support 
specify; 

0  1  2  3  4  w  lack  of  or  no  cooimunity  support 
specify; 

0  1  2  3  4  5  inability  to  do  cable  instructional  programming  due  to  unions 
specify; 

0  1  2  3  4  5  inadequate  funding  for  production  of  instructional  progranwning 
specify; 

0  1  2  3  4  5  Other:  

specify; 

0  1  2  3  4  5  Other;  

specify; 

0  1  2  3  4  5  Other:  

specify; 

4-Uhich  best  describes  the  the  reporting  relationship  of  the  station  (please  check  one). 

 ^The  station  is  dependent  upon  an  academic  unit  of  the  institution. 

 ^The  station  is  attached  to  an  academic  unit  but  also  has  a  wider 

institutional  mission  than  classroom  use  alone. 

 ^The  station  is  an  a(*nnistratiMe  unit  of  the  institution. 

 Other ;  


5. Do  you  perceive  a  reporting  relationship  problem?  Given  the  items  below  or  by  listing  others  you  may 
perceive,  circle  your  feeling  as  to  the  significance  of  these  problems  given  your  particular  station.  Add  any 
conments  for  clarification  of  your  responses  (optional*specify). 
OsRo  problem 

 5=a  serious  problem 

0  1  2  3  4  5  Is  it  clear  who  assigns  tasks? 
specify; 

0  1  2  3  4  5  Does  xh?  source  of  funding  conflict  with  day  to  day  workload? 
specify; 

0  1  2  3  4  5  Is  the  chain  of  command  clear? 
specify; 

0  1  2  3  4  5  Other;  

specify; 

0  1  2  3  4  5  Other:  

specify: 

0  1  2  3  4  5  Other;  

specify: 


2i}2 
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6.  Below  IS  a  list  of  reUtionship  areas  with  the  cable  companx.   Circle  xour  feeling  as  to  the  significance  of 
these  problems  given  your  particular  cUtion.  Add  any  comnents  for  clarification  of  your  responses 
(optional'specify), 

Osno  problem 

 5ga  serious  problem 

0  1  2  3  4  5  quality  control  of  progrannitigi 
specify: 

0  1  2  3  4  5  upgrading  of  equipment 
specify: 

9  1  2  3  4  5  censoring  of  programning 
specify: 

0  1  2  3  4  5  specification  on  amount  of  prograinmirj  hours 
specify; 

0  1  2  3  4  5  specification  on  times  of  scheduling 
specify: 

0  1  2  3  4  5  other:  

specify: 
0  1  2  3  4  5  other:^  

specify; 

7.  There  are  several  issues  regarding  public  access.  By  public  access  we  mean  the  public  ability  or  right  to 
use  the  cable  system  to  transmit  prograiming  (usually  for  a  fee). 

Do  you  provide  public  access.  ^Y«s  No 

8.  Below  IS  a  list  of  problem  areas  that  deal  with  public  access.   Circle  your  feeling  as  to  the  significance 
of  these  problems  given  your  particular  station.  Add  any  comnents  for  clarification  of  your  responses 
(optional-specify), 

9=no  problem 

 Sgg  serious  problem 

0  1  2  3  4  5  conflict  of  interest  between  the  institution  and  cable  company 
srecify: 

0  1  2  3  4  5  unprepared  clients  or  users 
specify: 

0  1  2  3  4  5  overuse  of  facilities 
specify; 

0  1  2  3  4  5  other:  

specify; 

0  1  2  3  4  5  other:  

specify; 

Section  <B)  -  Discu<>sion  of  the  critical  issues  of  the  organization. 
Respondent  Generated: 

From  the  above  description  items  on  organization  and  the  issues  generated  by  the  investirator ,  what  other 
issues  do  you  feel  are  significant  given  organisational  considerations  (opt!3nal). 


ORGANIZATION^  BUDGET^  PERSONNEL,  AND  EQUIPMENT 
Section  (A)  -  Description  of  the  budget. 

l.Uhat  IS  the  station's  estimated  total  operating  budget  in  a  given  f i  cal 
year  (12  months):  $  
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2.  Given  thif  total  bidg^i,  indicate  the  percentage  from  each  of  the  categonef  below,  thr  source  of  these 
funds. 

 General  ColltQe/liniversity  operating  funds 

 General  academic  dept^tment  operating  funds 

 Special  student  fees 

 >J  Outside  user  ^ees  including  grarits  and  or  contract 

 X  EndOMMnt  or  alunni  contributions 

 y  Other  I  

 Other:  

100  y  Total 

3.  Given  the  list  below,  circle  your  opinion  on  those  uudgetary  problems  which  are  representative  of  your 
particuUr  station.  Add  clarification  statements  if  neerled  (optional-specify). 

n^no  problem 

 Spa  serious  problem 

0  1  2  3  4  5  lack  of  a  commitment  by  the  administration 
specify: 

0  1  2  3  4  5  University  nas  insufficient  funds 
specify: 

0  1  2  3  4  5  station  lacks  a  fair  share  of  existing  funds  due  to  budgeting  polices 
specify: 

0  1  2  3  4  5  budget  operationf  are  dependent  upon  soft  monies  (grant  &  contract) 
specify: 

0  1  2  3  4  5  other:  

specify: 

0  1  2  3  4  5  other:  

specify: 

0  1  2  3  4  5  other:  

spec  I fy: 

4.  Does  the  cable  company  have  i^y  financi\l  carmitments  to  the  cable  station?  ^Yes  ^No 

If  yes,  check  any  appropriate  comnitments- 

 staffing 

 technical  support 

 equipment  replacement 

 other  :^  

 other :  

Do  any  of  the  above  commitments  cause  difficulties?  Please  explain- 


Section  <B)  -  Discussion  of  the  critical  issues  of  budgeting. 
Respondent  Generated: 

From  the  above  description  items  on  budgeting  and  the  issues  generated  by  the  investigator,  what  other  issues 
do  you  feel  are  significant  to  consider  under  budget  (optional). 
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ORGANIZATION,  BUDGET,  PBRSQNNBL.  AND  EQUIPMENT 


Section  (A)    Description  of  personnel. 

1. Could  ycu  please  ideittKx  the  number  of  RE  (Full-^timt  equivalent;  1.0-one  person  working  full-time  for  one 
:'ear)  which  directly  report  to  you  for  the  following  categories: 

 FTE  professional  staff 

 ^FTE  graduate  students 

 FTE  undergraduate  students 

 FTE  technical  support  staff 

 FTE  other  ^  

 FTE  other:  

vould  you  Dlease  identify  the  personnel  you  have  acctsc  to  but 
reports  to  another  adhiiiistrative  or  academic  unit. 

 FTE  other  

 ^FTE  other:^  ^  

 FTE  other:  .      


2.Frc3m  the  below  list  please  identify  the  amount  of  input  the  following  personnel  have  in  long-range  planning. 
O^perceiued  as  a  person  having  no  input 

 5ga  great  deal  of  input 

0  12  3  4  5  advisory  board 

0  1  2  3  4  5  department  chair  or  administrative  head 

0  1  2  3  4  5  station  managtr 

0  1  2  3  4  5  university  or  college  officials 

0  1  2  3  4  5  cable  company 

0  1  2  3  4  5  other:  

0  1  2  3  4  5  other:  


3. Below  is  a  potential  list  of  personnel  problems  you  may  be  experiencing.   Circle  your  opinion  on  those 
personnel  problems  which  are  representative  of  your  particular  s>tation.  Add  clarification  statements  if 
needed  (optional-^sperif^;. 
0=:no  pro^*lem 

 S^a  serious  problem 

0  1  2  3  4  5  inactive  advisory  board 
specify! 

0  1  2  3  4  5  inadequate  technical  support 
specify: 

0  1  2  3  4  5  directors  time  not  totally  devoted  to  station  operatior^i 
specify: 

0  1  2  3  4  5  heavy  reliance  or  students  for  d»ily  operations 
specify: 

0  1  2  3  4  5  inadequate  professional  staffing 
specify: 

0  1  2    4  5  inadequate  ongoing  professional  sti^ff  development 
specify: 

0  1  2  3  4  5  other:^  

specify: 

0  12  3  15  other;  

specify: 

Section  (B)  -  Discussion  of  the  critical  issues  of  personnel. 
Respondent  Generated; 

From  the  above  description  items  on  personnel  and  the  issues  generated  by  the  investigator,  what  other 
issues  do  you  feel  are  significant  to  consider  under  personnel  (optional). 
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ORGANIZATION,  BUDGET,  P  9S0NNEL,  AND  EOLUIPMENT 

Section  (A)  -  Description  of  equipment. 

1.  ')e1ow  ape  simple  yes/no  stfitements  to  quantify  and  qualify  your  facilities.   Check  off  the  appropriate 
response. 

 ^Ves  ^Mo  -Dots  the  station  have  a  production  studio? 

 ^Yes  No  H>oes  the  station  have  color  capability? 

 ^Yes  ^No  -Does  the  station  have  remote  equipment^ 

 ^Yes  ^No  -Does  the  station  have  editing  capability? 

2.  P1edSe  fi!l-in  or  check  the  appropriate  blanks  in  helping  uf.  to  define  your  equipment. 

VCRs :  Qu  an  1 1 1  y  Format  s^  

Audio  console:  Yts  No  

Film  chain  capacities:  I6mm        dm        SSnm  slides  

Character  generator:  Pages  of  memory  

Cameras:  Number  of  studio   Number  of  remote  

Time  base  corrector:  Yes  No  

Video  switching  capabilities:  Yes  No  

3.  Given  the  iTiissiofi  of  your  stationi  identify  the  equipment  problems  that  your  station  may  have.  Add 
clarification  statements  if  netded  (optionaWpecify). 

0=no  problem 

 5ga  serious  problem 

0  1  2  3  4  5  important  equipment  componentt  ^re  missing  from  a  desired  system 
specify: 

0  1  2  3  4  5  quality  of  equipment  is  not  at  desirable  level 
specify: 

0  1  2  3  4  5  more  of  existing  equipment  (quantity)  is  desirable 
specify: 

0  1  2  c  4  5  equipment  is  outdated 
specify: 

0  1  2  3  4  5  inadequate  physical  plant  and  facilities 
specify: 

0  1  2  3  4  5  inadequate  maintenance  of  equipment 
specify: 

0  1  2  3  4  5  other:  

specify: 

0  1  2  3  4  5  other:  

specify: 

Section  (B)  -  Discussion  of  th-  critical  issues  of  tquip*^*- 
Respondent  Generat^^d: 

From  the  above  description  ite*  *  on  equipment  4nd  the  issues  generated  by  the  investigator,  what  otner  issues 
do  you  feel  rire  significant  to  consider  under  equipment  (optional). 
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Selecting  Media  for  Instruction 

L.J.  Evans 
Department  of  Ed^^cational  Technology 
Arizona  State  University 
Tempe,  AZ  85287 


Runninty  head:     Selecting  Media 

ERIC 


Selecting  Media  2 


Abstract 

The  effects  of  instruction  in  using  a  formal  media  selection 
procedure  on  the  media  selection  choices  made  by  novice 
instructional  designers  is  examined.    An  informal  intuitive 
selection  procedure  is  compared  with  instruction  (inf ormat ionr 
practicer  and  feedback)  using  a  formal  media  selection  procedure 
developed  by  Reiser  and  Gagne  (1983).    Results  indicate  that 
students  who  use  the  media  selection  model  make  more  correct 
decisions  than  when  they  don't  use  the  model.     Alsor  students 
often  do  not  use  the  model  correctlyr  but  the  redundancy  in  the 
model  and  the  restricted  choices  available  increase  the 
probability  that  a  correct  choice  will  be  made. 
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Selecting  Media  for  Instruction 


Most  formal  media  selection  procedures  are  designed  to 
assist  developers  in  the  selection  of  the  appropriate  medium  to 
use  in  a  given  instructional  situation,    Higgins  and  Reiser 
(1985)  reported  that  subjects  who  read  a  review  of  the 
characteristics  of  media  selection  models  (Reiser  and  Gagne^ 
1982)  and  a  description  of  how  to  use  the  Reiser  and  Gagne  (1983) 
model  for  media  selection  were  more  likely  to  make  media  choices 
which  matched  those  of  experienced  instructional  designers, 
Howeverr  because  of  the  relatively  low  percentage  of  students  who 
made  correct  media  selectionsr  the  investigators  questioned  the 
adequacy  of  the  orientation  the  students  received  to  the  media 
selection  model.    The  current  study  presents  students  with 
additional  informationr  practice  and  feedback  in  using  the  model. 


Method 

Subjects 

Twenty-nine  male  and  female  graduate  students  enrolled  in  a 
media  design  course  at  Arizona  Sate  University  during  the  fall 
semester,  1985,  participated  in  the  study. 

Materials 

Four  of  the  media  design  problems  developed  by  Higgins  and 
Reiser  (1985)  were  used  in  this  study.     The  problems  were  written 
descriptions  of  various  instructional  situations  in  which  an 
instructional  presentation  had  to  be  developed.    Each  problem 
involved  a  different  content  area,  a  different  type  of  learning 
outcome,  and  a  different  instructional  setting.    The  problems  were 
entitled  Personnel  Interviewing,  Aircraft  Instrument 
Comprehension,  C,T,  Scan,  and  Instructional  Objectives,  each 
title  reflecting  the  subject  matter  of  the  instructional  program 
to  be  designed. 

Each  problem  included  information  about  the  purpose  of  the 
instruction  and  specific  instructional  objectives.    The  problems 
also  included  descriptions  of  the  instructional  setting,  the 
intended  audience,  tne  media  budget  available,  and  the 
instructional  functions  of  the  media  to  be  selected. 

Each  media  selection  problem  had  a  designated  "correct" 
medium  for  use  in  that  situation.     These  correct  media  choices 

were  identified  by  two  experienced  instructional  designers  using 
the  Reiser  and  Gagne  media  selection  model. 

Procedures 
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The  participants  selected  media  under  two  conditions:  an 
informal  intuitive  condition  and  a  forma]  media  selection 
condition.      The  C.T.  Scan,  Personnel  Interviewing,  and  Aircraft 
Instrument  Comprehension  problems  were  randomly  assigned  to  the 
students  under  the  intuitive  condition,.    Students  were  directed 
to  read  the  problem,  select  the  most  appropriate  media  or  medium, 
and  write  a  brief  ration        for  their  selection.      No  feedback 
was  given  on  the  appropriateness  of  their  media  selection. 

Following  the  intuitive  condition,  students  were  instructed 
to  read  the  review  by  Reiser  and  Gagne  ,1982)  and  the  material  by 
Reiser  and  Gagne  (1983)  describing  how  to  use  the  Reiser  and 
Gagne  media  selection  model.    Students  were  directed  to  read  the 
articles  during  the  next  week  and  use  the  formal  model  to  make  a 
media  selection  for  the  Instructional  Objectives  problem.  They 
were  asked  to  record  the  step-by-step  decisions  they  made  while 
working  through  the  model,  and  to  record  the  amount  of  time 
required  to  study  the  readings  and  use  the  model,  and  again 
were  asked  to  write  a  brief  rationale  for  their  decision. 

At  the  end  of  the  week,  the  correct  answer  as  well  as  the 
rationale  behind  its  selection  was  discussed  in  class.  Questions 
regarding  the  use  of  the  model  were  answered.    At  the  end  of 
class,  students  were  assigned  to  the  C.T.  Scan,  Personnel 
Interviewing,  or  Aircraft  Instrument  Comprehension  problem,  such 
that  each  student  was  systematically  assigned  a  different  problem 
than  in  the  intuitive  condition.    They  were  instructed  to  work 
through  the  problem  as  in  the  practice,  and  they  were  iiiformed 
that  this  was  one  of  six  graded  assignments  that  would  be  used  to 
determine  their  course  grade. 

Results 

In  the  intuitive  condition,  36%  of  those  students  with  the 
C.T.  Scan  problem  and  55%  of  those  with  the  Personnel 
Interviewing  problem  made  the  correct  media  selection.     None  of 
the  students  assigned  the  Aircraft  Instrument  Comprehension 
problem  made  the  correct  media  selection.    A  total  of  32%  of  the 
students  made  the  correct  media  selection  decision.    These  data 
are  summarized  in  Table  1. 

After  reading  the  materials  and  working  through  the  media 
selection  model  with  the  Infc:truct ional  Objectives  problem,  55%  of 
the  students  made  correct  media  selections.    However,  56%  of 
those  who  made  correct  selections  did  not  work  through  the  model 
properly.      Seventeen  percent  of  the  students  used  the  model 
properly  but  made  an  error  in  fina]  media  selection.  Fourteen 
percent  of  the  students  neither  used  the  model  properly  nor  made 
the  correct  final  media  selection  decision.    These  data  are 
summarized  as  Table  2. 

In  the  final,  test  condition,  students  again  used  the  model 
to  select  media  for  one  of  the  instructional  problems,  but  this 
time  they  were  told  that  their  performance  wouJd  count  as  part  of 
their  grade.    Of  the  29  students,  a  total  of  2fi  (96%)  made  the 


ERIC 


210 


Selecting  Media  5 


correct  media  selectiorir  but  only  40%  of  those  who  made  correct 
media  selections  also  used  the  model  correctly.    This  information 
is  presented  in  Table  3. 

Discussion 

Performance  in  the  intuitive  condition  indicates  that 
selecting  media  for  given  problems  is  fairly  difficulty  since 
only  32%  of  the  studerts  made  the  correct  media  selection.  It 
can  also  be  inferred  from  the  differential  performance  on  the 
media  selection  problems  in  the  intuitive  condition  that  the 
problems  vary  in  difficulty.     None  of  the  nine  students  who  were 
assigned  the  Aircraft  Instrument  Comprehension  problem  were  able 
to  make  the  correct  media  selection  intuitivelyr  although  36%  of 
those  attempting  the  C.T.  Scan  problem  and  55%  of  those 
attempting  the  Personnel  Interviewing  problem  were  able  to  make 
correct  ^elections 

After  practice  and  self-instruction  in  use  of  the  Reiser- 
Gagne  media  selection  model ,  students  are  able  to  make  correct 
choices  more  often.    This  may  be  partially  due  to  the  redundancy 
built  into  the  model r  since  the  same  media  choices  appear  in 
several  of  the  final  choice  boxes  in  the  flowchart.  Performance 
in  the  practice  condition  also  indicates  that  students  are  unable 
to  use  the  model  effectively  based  upon  reading  alone. 

Performance  in  both  the  practice  and  test  conditions 
indicates  that  the  model  is  fairly  difficult  to  use.        Only  24% 
of  the  students  in  the  practice  condition  and  40%  in  the  test 
condition  were  able  to  use  the  model  correctly  to  make  the 
correct  media  selection.    Howeverr  in  the  test  condition  96%  of 
the  students  made  the  correct  media  selectionr    This  again 
indicates  that  the  redundancy  within  the  model  helps  to  restrict 
media  selections^  even  though  it  is  used  incorrectly.    It  can 
also  be  seen  that  students  get  better  at  using  the  model  correctly 
as  they  gain  experiencec 

It  can  tentatively  be  concluded  from  this  study  that  students 
who  use  the  Reiser-Gagne  media  selection  model  make  more  correct 
media  selection  decisions  than  when  they  don't  use  the  model. 
Alsor  students  often  do  not  use  the  model  correcLlyr  but  the 
redundancy  in  the  model  and  the  restricted  choices  available 
increase  the  probability  that  a  correct  choice  will  be  made. 
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Tablo  1 

Intuitive  Media  Selection  Prnr^Aurt^j  Proporhinn  of  Students 
Makifiy  Correct  Media  Select-inng 


Media  Selection  Problem  Assigned 


Aircraft 
Personnel  Instrument 
C.T.  Scan      Interviewing  Comprehension 


Correct  Media  4  (36%)  6  (55%)  0  (0%) 

Selected 

Incoirect  Media  7  (63%^   S_  311  9  aO0%^ 

Totals  11  1).  9 
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Table  2 


Reiser-Gaqne  Model  Qse:  Practice  finBtrucMonai  Qh^pfifiYfS 
Workshop  Problem)  -  Proportion  of  S^uAf^ptR  nfiin9  Flowchart 
Properly  and  Italcln9  C^f  r^gt;  ffedict  Sel€Ctiras_ 


Correct  Model  Use/  7  (24%) 
Correct  Media  Selection 

Incorrect  Model  Use/  9  (31%) 

Correct  Media  Selection   

Total  Correct  Media  Selection  16  (55%) 

Correct  Model  Use/  5  (17%) 
Incorrect  Media  Selection 

Incorrect  Model  Use/  4  (14%) 
Incorrect  Media  Selection 

Unable  to  complete  assignment  4  fl4%^ 

Total  29 
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Table  3 

Reiser  &  Gaqne  Model  Osei  T<>sti 


Media  Selection  Problem  Assigned* 


Aircraft 
Personnel  Instrument 
C.T.  Scan    Interviewing  Comprehension 


Correct  Model  Use/ 
Correct  Media  Selection 

Incorrect  Model  Use/ 
Correct  Media  Selection 

Total  Correct 

Media  Selection 

Correct  Model  Use/ 
^  orrect  Media  Selection 

-  correct  Model  Use/ 
Incorrect  Media  Selection 


3  (30%) 

6  (60%) 
"?  (31%) 

1  (3%) 

0 


7  (60%) 

4  (36%) 
IT  (38%) 

0 

0 


1  (12%) 

7  (88%) 
1  (27%) 

0 

0 


*    n  = 


n=29 
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INTRODUCTION 


What  is  the  problem? 

Responding  to  direction  from  the  Board  of  Regents,  the  College  of  Education  at 
the  University  of  Georgia  has  entered  into  several  cooperative  programs  to  offer 
advanced  graduate  degree  programs  in  the  south  Georgia  area.    While  these  programs  are 
meeting  very  real  needs  frr  students  in  that  area,  they  are  causing  more  than  ordinary 
time  demands  of  the  UGA  professional  staff.    Any  technology  that  can  reduce  this 
nonproductive  use  of  the  instructor's  time  while  maintaining  or  increasing  the 
interaction  between  instructor  and  students  warrants  further  study  and  investigation. 

What  is  the  specific  context  of  the  problem? 

Since  the  spring  of  1982,  the  College  of  Education  at  the  University  of  Georgia 
has  operated  a  doctoral  program  for  health  professionals  on  the  campus  of  Armstrong 
State  College  in  Savannah,  Georgia.    The  program,  which  allows  students  to  pursue  the 
Doctorate  in  Education  (Ed.D.)  in  the  areas  of  curriulum  or  instructiona*^  development, 
was  designed  especially  for  health  professionals  who  are  involved  in  education  or 
training. 

The  opportunity  to  receive  their  doctoral  instruction  at  the  local  campus  gives 
students  several  unique  advantages.    First,  they  avoid  the  turmoil,  both  to  their 
careers  and  to  their  families,  of  relocating  in  Athens.    They  continue  with  their 
present  jobs,  attending  class  during  late  afternoon  and  night.    Second,  they  avoid  the 
expense  of  moving  to  another  town  and  of  losing  the  income  from  their  present  jobs. 
Third,  they  have  the  singular  opportunity  to  apply  what  they  are  learning  immediately 
to  their  jobs. 

Operating  a  doctoral  program  so  far  away  from  the  UGA  campus  in  Athens,  however, 
poses  special  problems  for  faculty  and  students.    For  the  faculty,  the  most  obvious 
problem  is  travel.    By  car,  travel  from  Athens  to  Savannah  requires  about  four  and  a 
half  hours.    Since  classes  begin  in  the  late  afternoon,  faculty  must  stay  overnight. 
So  a  class  in  Savannah  requires  UGA  faculty  to  spend  two  workdays  away  from  campus. 
In  addition  to  the  problem  of  physical  distance,  faculty  must  cope  with  the  reduced 
opportunity  to  work  and  communicate  with  students.      The  College  of  Education  and  its 
faculty,  then,  face  several  problems:    increased  expenses  due  to  faculty  travel,  loss 
of  productive  faculty  time  in  travel,  and  reduced  opportunities  to  interact  with 
students. 

Students  also  encounter  problems  in  pursuing  their  doctoral  studies  away  from  the 
UGA  campus.    Library  resources  are  not  always  readily  at  hand,  nor  is  the  friendly 
advice  and  presence  of  other  doctoral  students  familiar  with  the  program  and  with  the 
professors  who  teach  in  it.    The  faculty  themselves  aro  encountered  one  at  a  time  with 
little  opportunity  for  additional  contact  during  the  v  ek. 

What  is  the  purpose  of  this  study? 

The  purpose  of  this  study  was  to  examine  the  process  of  introducing,  maintaining, 
and  using  an  innovation,  the  electronic  bulletin  board,  within  the  off-campus  doctoral 
program  ot  Armstrong  State  College.    In  particular,  we  wanted  to  conduct  the  study 
within  a  specific  classroom  setting,  addressing  several  questions: 
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1.  What  are  the  students'  currerio  levels  of  experience  with 
computers? 

2.  Will  they  voluntarily  choose  to  use  the  electronic  bulletin 
board? 

3.  How  do  they  evaluate  its  effectiveness? 

4.  How  do  we  evaluate  its  effectiveness? 

5.  What  modifications  can  we  make  to  improve  its  continued  use? 

METHOD 

Who  were  the  participants? 

fourteen  doctoral  students  enrolled  in  an  advanced  course,  Research  in 
Instruction,  participated  in  this  study.    Students  we^^e  employed,  primarily  as 
educators,  in  the  health  fields  such  as  nursing,  dental  hygiene,  and  radiological 
technology.    They  have  been  enrolled  in  this  program  for  approximately  four  years  and 
have  taken,  for  the  most  part,  the  same  sequence  of  course  work.    The  group  consisted 
of  thirteen  females  and  one  male,  and  ranged  in  age  from  30  to  52. 

What  was  the  context  of  the  study? 

A  doctoral  program  of  st'/'y  involves  several  distinct  phases:    (a)  taking  course 
work;  (b)  passing  preliminary  written  and  oral  exams;  (c)  developing  a  dissertation 
prospectus;  (d)  conducting  the  study;  (e)  writing  up  the  results;  and  (f)  obtaining 
approval  of  the  dissertation  via  a  reading  committee  and  final  oral  exam.    Students  in 
this  study  were  at  level  (b)  the  quarter  during  which  the  electronic  bulletin  board 
was  introduced.    They  were  anticipating  standing  the  written  and  oral  preliminary 
exams.    In  other  words,  they  were  moving  from  the  familiar  pattern  of  taking  courses 
to  the  unfamiliar  and  anxiety  producing  stage  of  t..e  preliminary  exams.    In  short,  the 
electronic  bulletin  board  was  introduced  at  a  very  stressful  time  for  the  students. 

Second,  the  course  being  offered  (Research  in  Instruction)  did  not  follow  the 
typical  pattern  of  students  receiving  instruction  each  week,  taking  quizzes,  preparing 
papers,  and  so  forth.    Rather,  this  course  allowed  each  student  to  work  independently 
Lu  prepare  for  the  preliminary  exams.    A  different  type  of  instructional  strategy, 
then,  was  needed.    Communication  between  students  and  faculty,  rather  than  formal 
study,  was  required. 

Third,  the  use  of  the  bulletin  board  was  voluntary.    It  was  presented  as  a  useful 
tool  for  facilitating  communications  between  students  and  faculty.    No  one  was 
required,  for  example,  to  sigr  on  or  post  a  specified  number  of  messages. 

Fourth,  as  one  might  expect,  some  students  were  familiar  with  using  personal 
computers,  others  were  not.    Some  students  owned  personal  computers,  modems,  and 
communication  software,  others  did  not.    This  information  will  be  described  later. 
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What  did  we  do? 

We  conducted  two  major  activities:    installed  and  monitored  the  electronic 
bulletin  beard  and  provided  a  training  session  on  the  ijse  of  the  system.    Each  of 
these  activities  is  described  below. 

Installation  and  Monitoring 

A  Tandy  1200  (640K  and  a  10  megabyte  hard  disk;  was  installed  in  the  Armstrong 
Department  of  Nursing,  connecting  the  computer  via  inodem  to  one  of  the  departmental 
pfione  lines.    We  had  previously  tested  the  operation  of  tiiis  computer  by  running  a 
campus  bulletin  board  on  it  for  a  twc-week  period. 

The  software  package  used  was  the  Remote  Bulletin  Board  System  for  the  IBM 
Personal  Computer  or,  as  it  is  more  commonly  known,  the  RBbS-PC.    This  program  was 
developed  and  still  maintained  by  the  Capitol  PC  User  Group  in  Gai thersburg,  Maryland. 
The  RBBS-PC  package  is  copywrited  but  is  available  at  no  cost,    ^or  a  modest 
contribution  of  twenty-five  dollars  to  the  Capitol  PC  User  Group,  a  user  will  be 
registered  and  notified  of  "urther  improvements  in  the  package. 

The  major  features  of  the  RBBS-PC  are  l  rr.essage  system,  a  bulletin  system,  and  a 
filing  system.    The  message  systems  allows  250  active  messages,  which  may  be  private 
or  available  to  anyone.    The  bulletin  syster.  is  operated  only  by  the  sy*?tem  operator 
and  contains  announcements  or  other  infornation    hat  is  permanently  posted.  The 
filing  system  allows  the  uploading  and  downloading  of  text  documents  or  programs. 
RBBS-PC  also  has  an  option  for  assigning  different  levels  of  security  for  users,  which 
increase  or  decrease  the  user's  access  to  the  entire  package. 

A  special  program  was  written  to  initialize  the  RBBS  program  immediately  when 
the  computer  was  turned  on  so  with  the  flip  of  a  switch  tnt:  system  was  ready  for  tjse. 
The  system  initialized  and  was  then  ready.      "^he  board  operated  from  5:00  PM  to  9:Uu 
AM  weekdays  and  24  hours  a  day  on  weekends. 

The  logic  of  placing  the  host  computer  in  Savannah  was  that  it  required  only 
local  calls  for  students.    We  would  call  long  distance  on  GIST  from  Athens,  thereby 
assuming  the  major  phone  expense.    The  system,  then,  had  to  be  monitored  renotely  from 
Athens,  which  was  a  disadvantage  to  the  system  operator. 

Training  Session 

A  two-hour  training  session  was  held  during  the  second  class  meeting  of  fall 
quarter,  1985,  on  the  same  day  that  the  computer  was  installed.    Students  met  one  of 
our  two  systems  operators,  a  graduate  student  enrolled  in  the  on-campus  program  in 
instructional  development,  who  then  demonstrated  the  major  features  of  the  RBBS 
package.    An  eleven-page  description  of  the  program  was  distributed.    Major  topics 
included  signing  on,  the  help  file,  reading  messages,  leaving  a  message,  the  utilities 
menu,  the  files  system. 

At  the  time  the  training  session  was  conducted,  an  informal  survey  of  students 
indica"ced  that  seven  out  of  the  eleven  present  owned  a  personal  computer.  Five 
students  owned  modems  and  communications  software;  four  haH  placed  calls  to  an 
electronic  bulletin  board  or  electronic  mail  service.    We  made  arrangements  for  a  FRS 
Model  100  computer,  an  inexpensive  yet  adequate  computer  with  a  built-in  modem,  to  be 
m^de  ?ivail;^ble  for  each  student  who  did  not  own  or  have  access  to  a  computer. 
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What  data  did  we  collect? 

Students  knew  generally  that  we  would  collect  data  at  the  end  of  the  qucn  uer  on 
the  operation  or  the  system  and  on  their  reactions  to  this  experience.      Upon  further 
reflection,  however,  we  concluded  that  this  informa"'  approach  was  unfair  to  the 
••tudents.    They  should  know  ve^^y  specifically  whaL  data  we  would  collect,  how  it  would 
be  collected,  who  would  do  it,  and  what  use  would  be  made  of  the  data.    We  therefore 
developed  a  consent  ^       that  clearly  explained  cjr  intentions.    Two  major  items  from 
this  form  are  given  telow. 

The  following  points  have  been  explained  to  me: 

1)  The  reason  for  the  research  is  to  assess  the  feasibility  and 
effectiveness  of  the  electronic  bulletin  board  as  a  communication  tool  in 
our  off-campus  doctoral  program.    The  advantages  that  I  may  expect  from  it 
are:    (a)  insures  that  specific  problems  you  may  encounter  when  using  the 
bulletin  board  n^^e  addressed,  (b)  provides  a  systematic  record  of  your 
reactions  to  the  bulletin  board,  (c)    insures  effective  use  of  the  board 
with  future  classes,  (d)  models  action  research  dealing  with  use  and 
acceptance  of  an  inno^'ation. 

2)  The  procedures  are  as  follows:    (a)  You  will  be  asked,  via  interviews 
and/or  self-report,  to  describe  your  level  of  use  of  the  bulletin  board, 
problems  you  encountered,  and  conditions  that  would  make  it  a  more  effective 
communication  tool.    This  information  will  be  collected  once  each  quarter, 
(b)  You  will  also  be  asked,  via  a  questionnaire,  to  share  your  concerns 
about  this  innovation.    For  example,  -Do  you  need  more  information  about  it? 
Would  you  prefer. LO- use  a  different  way  of- communicating?-  This  information  - 
will  be  collected  once  each  quarter,    (c)  Data  will  be  collected  over  a 

three  quarter  period,    (d)  Statistics  on  use  and  operation  of  the  board  will 
be  kept.    In  no  circumstance,  however,  will  the  content  of  a  message  be  a 
part  of  this  study.    Your  messages  will  receive  the  level  of  security  that 
you  assign  and  will  not  be  seen  by  anyone  other  than  the  person  or  persons 
you  designate  and  the  systems  operator. 

Students  read  the  consent  form,  asked  for  a  few  clarifications,  and  then  all  eleven 
present  at  the  last  class  meeting  signed  the  consent  forms. 

As  item  2  in  the  consent  form  shows,  three  types  of  information  were  obtained: 
(a)  self-report  about  their  level  of  use  of  and  reactions  to  the  bulletin  board;  (b) 
response  to  a  questionnaire  about  their  concerns  ebout  the  bulletin  board;  and  (c) 
statistics  on  the  use  of  the  bulletin  board,  which  came  directly  from  the  RBBS 
program. 

The  self-report  form  consisted  of  nine  items  requesting  such  information  as  "3. 
Did  you  have  any  problem(s)  in  using  the  Bulletin  Board?"  and  "6.  Should  the  Bulletin 
Board  be  continued  next  quarter?" 

The  Stages  of  Concern  Questionnaire  (SoCQ)  developed  by  Hall,  George,  and 
Rutherford  (1979)  was  the  questionnaire  used  to  measure  students'  concerns  about  the 
bulletin  board  as  an  instructional  innovation.    Hall  et  al.  make  two  major  assumptions 
about  the  individual  adopter:    first,  that  individuals  niove  through  seven  stages  of 
concern  about  the  innovation,  and  second,  that  the  intensitv  of  concerns  varies  from 
stage  to  stage.    For  erample,  a  person  who  is  a  "non-user"  of  an  innovation  would  have 
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a  different  profile  of  concerns  than  a  "user."  Moreover,  the  non-user  profile  would 
change  as  that  individual  becomes  an  experienced  user. 

Broyles  and  Tillman  (1985,  p.  366)  described  the  seven  specific  stages  of  the 
SoCQ  as  follows: 


0  Awareness 

1  Informational 

2  Personal 

3  Management 

4  Consequence 

5  Collaboration 

6  Rofocusing 


Little  concern  or  involvement  with 
the  project. 

Need  for  general  information. 

Uncertainty  about  her/his  role  in  the 
project. 

Attention  to  the  processes  and  task  of 
using  the  project. 

Focus  on  the  impact  of  the  project  on 
the  learner. 

Kocus  on  coordination  and  cooperation 
with  others  regarding  the  project. 

Exploration  of  alternative  uses  of  the 
prcject  or  a  replacement. 


What  did  we  find? 


In  reviewing  the  findings  presented  below,  several  important  features  of  this 
study  should  be  kept  in  mind.    First,  the  introduction  of  the  bulletin  board  came  at  a 
very  stressful  time  for  studer'      taking  preliminary  written  and  oral  examinations. 
While  students  generally  welco•^etJ  it  as  a  useful  tool,  it  was  clearly  adjunctive  or, 
for  a  few  students,  unnecessary  at  that  moment.    Second,  the  use  of  the  bulletin  board 
was  purely  voluntary.    No  minimum  number  of  sign-on's  were  required.    Third,  at  the 
time  the  host  computer  was  installed,  only  five  students  had  the  necessary  hardware  to 
link  up  with  the  system.    Although  we  would  have  preferred  that  all  students  have  the 
necessary  equipment  at  the  start  of  the  quarter,  this  could  not  be  achieved  without 
delaying  the  ins'     lation  of  the  host  computer.    By  the  end  of  the  quarter,  most 
students  did  have  access  to  the  bulletin  board.    In  several  cases,  the  availability  of 
the  board  prompted  students  to  purchase  their  own  personal  computers. 

Findings  are  presented  in  four  sections:    summary  of  R3BS  usage,  se^f-repo^t 
results,  responses  to  the  SoCQ,  and  initial  costs. 

Summary  of  RBBS  Usage 

The  number  of  times  each  user  signed  on  the  RBBS  over  a  ten  week  period  from 
October  to  December  can  be  summarized  as  follows: 
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Person 


Ncinber  of  times  signed  on 


Instructor 
Student  1 
Student  2 
Student  3 
Student  4 
Student  5 
Student  6 
Student  7 
Others 


Sysop  1 
Sysop  2 


15 

n 

13 
41 
11 
10 
5 
2 
1 
1 
5 


These  data  show  very  clearly  that  only  half  of  the  students  signed  on  the  bulletin 
board  during  fall  quarter.      "Others"  were  callers  who  were  checking  out  the  new 
board.    No  files  were  uploaded  or  downloaded. 

Self-Report  Results 

A  survey  of  RBBS  usage  was  given  during  the  last  class  meeting.    Eleven  of  the 
fourteen  students  were  present.    Of  those  eleven,  six  had  used  the  board  and  five  had 
not.    When  asked  ''Why  did  you  not  use  the  board?"  four  replied  "lack  of  equipment"  and 
one  "didn't  know  how."    Three  of  the  four  who  lacked  equipment  also  mentioned  that 
they  did  not  need  the  board  that  Quarter. 

Of  those  who  used  the  board,  a  variety  of  problems  were  encountered:    (1)  one 
student  was  tagged  with  a  security  violation  and  access  was  then  withheld  (apparently 
the  student  repeated  an  incorrect  command  three  times  so  the  RBBS  program  decided  a 
criminal  was  at  work);  (2)  several  attempts  to  upload  and  download  files  were 
unsuccessful;  (3)  use  of  nicknames  in  addressing  messages  would  result  in  undelivered 
messages;  (4)  a  user  would  be  knocked  off  the  board  automatically  after  two  minutes  of 
inactivity;  (5)  occassionally,  the  computer  would  not  be  turned  on  at  5:00. 

Also  from  those  who  used  the  board,  several  suggestions  for  improvement  in  the 
system  were  obtained:    (1)  increase  access  time  by  having  a  separate  phone  line;  (2) 
train  other  University  of  Georgia  faculty  in  the  use  of  the  board;  and  (3)  post  more 
information  of  general  interest  to  all. 

And  finally,  students  were  asked  two  specific  questions:    (1)  "How  frequently  do 
you  plan  to  use  the  board  next  quarter?"  Eight  replied  "more  than  this  Quarter"  and 
two  'about  the  same."    (2)  "Should  the  board  be  continued  next  quarter?'    Ten  replied 
"yes";  one  record  was  incomplete. 

Responses  to  the  Stages  of  Concern  Questionnaire  (SoCQ) 

Eleven  students  completed  the  SoCQ.    Fo»^  each  record,  raw  scores  for  the  seven 
stages  were  converted  to  percentiles,  then  plotted.    Two  groups  of  student  records 
were  formed.    One  consis\;ed  of  the  three  most  frequent  users  of  the  bulletin  board. 
The  other  consisted  of  five  sttidcnts  who  did  not  use  the  board.    Profiles  of  these 
groups  were  averaged,  plotted,  and  then  compared.    The  resulting  profiles  conform  to 
the  predictions  of  the  concerns  model:    the  nonuser  group  of  five  showed  very  high 
intensity  of  concerns  in  the  first  three  stages  (awareness,  informational,  and 
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personal)  with  less  intense  concerns  for  the  four  remaining  stages.    Their  concerns, 
then,  we^e  in  obtaining  more  information  and  in  determining  how  they  might  use  the 
bulletin  board;  they  were  not  concerned  about  collaborating  with  coMeagues  about  the 
bulletin  board.    The  user  grou;j,  however,  showed  a  different  pattern  of  concerns: 
lower  awareness,  informational,  and  personal  but  much  higher  on  collaboration.  This 
user  group  had  yet  to  show  concerns  for  refocusing,  which  the  concerns  model  would 
py^edict  for  experienced  users.    In  short,  concerns  theory  appeared  to  describe  quite 
well  the  two  user  groups  that  we  formed. 

Our  primary  use  of  this  data,  however,  was  to  develop  an  appropriate  intervention 
for  each  student  based  on  his  or  her  unique  profile.    These  data  will  also  be  shared 
with  students.    The  SoCQ  will  also  be  given  at  the  end  of  winter  and  spring  quarters. 


Initial  Costs 

Our  original  projection  for  equipment  called  for  a  budget  of  $9,600,  which 
included  one  Tandy  model  1200  with  accessories,  ten  model  100  portable  computers,  and 
one  printer.    Our  actual  equipment  expenses,  however,  were  these: 

1    Tandy  1200  HD  with  monitor,  graphics  $2,Z95 
adapter,  and  cables 

1    Modem  350 


3    Model  100  (24K)  with  cables,  carrying  1,555 
cases,  and  AC  adaptor   

Total  $4,200 


The  system  operator's  salary  for  the  quarter  would  add  an  additional  $1,000  to 
this  total  (10  hours  per  week  at  $10  per  hour  for  10  weeks)  as  well  as  the  GIST  phone 
calls  to  Savannah,  estimated  at  $150  (GIST  does  not  provide  actual  cost  billing).  The 
total  expenses  then  add  up  to  $5,350.    This  figure  does  not  reflect  any  equipment 
costs  from  the  Athens  end.    We  already  had  the  needed  equipment.  Additional 
improvements,  such  as  a  printer  in  Savannah  and  a  dedicated  phone  line,  will  of  course 
increase  this  figure. 

We  did  not  project  any  sort  of  cost  benefit  ratios  since  most  of  this  quarter  was 
devoted  to  installing  the  system.  With  additional  experience  in  operating  the  system, 
we  will  examine  carefully  this  important  dimension. 


Where  do  we  go  from  here? 


Our  initial  view  of  establishing  a  bulletin  board  focused  on  equipment,  budget, 
and  logistical  problems.      And  indeed,  it  took  virtually  the  entire  quarter  to  develop 
an  operational  system,  including  installation  and  monitoring  the  system,  training 
students  in  its  use,  and  procuring  equipment  so  students  can  have  access  to  the 
system.      On  this  score,  we  have  simply  just  begun.    We  have  an  operational  system, 
but  one  thai:  is  not  functioning  well  for  all  its  potential  users.    Only  half  of  the 
students  have  actually  used  the  system. 

After  ten  weeks  of  operation,  however,  we  have  become  more  aware  of  the 
student's  view  of  the  system.    Some  students,  for  example,  need  additional  practice  in 
using  the  basic  system.    Yet  others,  want  to  share  information  about  the  bulletin 
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board  with  colleagues  and  locate  and  use  additional  bulletin  boards  in  th^ir  specialty 
areas.    Also,  more  linkages,  for  example,  need  to  be  made  between  Armstrong  State 
students  and  University  of  Georgia  faculty  and  students. 

We  are  encouraged  that  the  students  themselves,  those  who  have  used  the  system 
and  those  who  have  not,  strongly  support  the  continued  operation  of  the  bulletin 
board.    Both  they  and  we  remain  optimistic  that  a  significant  new  communication  tool 
is  being  forged. 
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ABSTRACT 


In  order  to  individualize  instruction,  computer-based  lessens  often  allov  the 
learner  to  determine  which  material  vill  be  covered,  and  the  sequence  to  be 
followed.  Unfortunately,  subjects  who  control  their  instructional  decisions 
often  perform  worse  than  subjects  under  program  control  This  study 
eiamined  the  relationship  between  self-assessed  understanding  of  lesson 
content  and  performance  on  factual  and  inferential  test  questions  among  50 
college  undergraduates.  Analysis  showed  little  or  no  correlation  between 
ratings  of  understanding  and  subsequent  preformance  on  both  embedded 
questions  and  a  posttest  This  apparent  inability  to  accurately  assess 
understanding  may  help  to  eiplain  why  subjects  who  control  their  own 
instructional  decisions  tend  to  terminate  instruction  prematurely. 


226 


Cognitive  Monitoring 
3 


THE  ACCUKACT  OF  COGNITIVE  MONITORING 
DURING  COMPUTER-BASED  INSTRUCTION 


Individuals  process  information  in  difTerent  ways.  The  strategies 
preferred  by  one  learner  are  likely  to  differ  from  those  preferred  by 
another.  Ideally,  every  lesson  should  be  individuadly  tailored  to  suit  the 
needs  and  abilities  of  each  learner  "so  as  to  develop,  compensaf^e  for,  or 
capitalize  upon  student  characteristics  for  the  optlmlzaUon  of  subject-matter 
learning"  (Messick,  1984,  p.  69).  One  way  to  aooomplish  such  individual 
tailoring  is  by  transferring  control  of  the  lesson's  struaure  and  sequence 
to  the  learner.  The  greater  the  learner  control,  the  more  individualized 
instruction  should  become. 

Unfortunately,  research  in  this  area  has  failed  to  demonstrate  that 
learner  control  consistently  improves  learning.  Instead,  studies  indicate  that 
imposed  control  increases  learning  significantly  over  programs  in  which  the 
learner  controls  the  instructional  scope  and  sequence  (See,  for  eiample. 
Atkinson,  1972;  Park  &  Tennyson,  1983;  Ross  &  Rakov,  1981;  Ternyson. 
Tennyson  &  Rothcn,  1980;  Tennyson  &  Buttrey,  1980;  Tennyson,  Christensen 
&  Park,  1984).  Tennyson  (1980,  p.  505)  suted  that  "instructional  research 
dealing  with  variables  of  learner  control  has  failed  to  demonstrate  that 
students  can  make  and  carry  out  decisions  of  content  element  selection  and 
personal  learning  assessment ' 

A  basic  problem  noted  by  locus  on  instructional  control  researchers 
has  been  tnat  subjects  who  controlled  their  instruction  frequently 
terminated  instruction  prematurely.  However,  the  cause  of  this  phenomenon 
is  not  clear.  If  subjects  who  control  instruction  direct  as  much  effort  to  learn 
as  those  under  program  control,  then  other  factors  must  affect  instructional 
control  decisions. 

One  possible  explanation  is  that  many  learners  do  not  assess 
accurately  their  understanding  of  lesson  information.  Less  skilled  learners, 
and  perhaps  learners  who  encounter  new  subject  matter,  tend  not  to  detect 
their  failure  to  understand  new  material  (August.  Flavell  &  Clift,  1984; 
Baker,  1979;  FlavdU,  1979;  Garner,  1981;  Garner  &  Anderson,  1982;  Grabe  & 
Mann,  1984;  Markman,  1977;  Robinson  &  Robinson,  198i;  Whimbey,  1976). 
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If  instructional  control  decisions  are  made  based  upon  accurate  student 
comprehension  monitoring,  successful  outcomes  should  be  expected;  if  based 
upon  monitoring  that  is  ineffective,  however,  the  outcomes  of  learner- 
directed  lessons  are  likely  to  be  poor.  The  accuracy  of  student 
comprehension  monitoring,  therefore,  is  a  critical  variable  ia  learner- 
directed  computer-based  instruction. 

Deese  (1969)  suggested  that  understanding  is  an  introspective 
process  that  each  person  is  capable  of  recognizing.  This  is  supported  by 
Hart's  (1967)  vork  demonstrating  that  perceptions  of  comprehension  were 
very  accurate  when  compared  with  a  subsequent  reoogniUon  posttest. 
Several  studies,  however,  contradict  Deese  and  Hart's  hypotheses,  indicating 
that  learners  are  not  always  good  judges  of  their  understanding  (August, 
FlaveU  &  dift,  1984;  Baker.  1979;  Bransford  &  Nitich.  1978;  Brown. 
Campione  &  Barclay.  1979;  Garner  &  Anderson.  1982;  Goetzfried  &  Hannafin. 
1983;  Markman.  1977;  Robinson  &  Robinson.  1984;  Whimbey,  1976).  In 
these  studies  subjects  either  thought  they  understood  or  ignored  their  lack 
of  comprehension  during  instruction. 

The  types  and  levels  of  learning  are  also  likely  to  influence  both  self- 
assessment  and  en-route  comprehension.  Numeroui  studies  have  shown 
that  main  ideas  are  better  remembered  than  details  (Britton,  Simpson, 
Meyer,  Holdredge  &  Curry.  1979;  Johnson,  1970;  Kintsch,  1974;  Kinisch  & 
Keenan.  1973;  Meyer.  1975;  Meyer  &  Rice,  1981;  Walker  &  Meyer.  1980).  It 
may  be  the  undersunding  of  these  main  ideas  upon  which  subjects  base  self 
assessments.  Meyer  and  others  developed  a  system  for  identifying  the  level 
of  propositions  in  teit,  and  concluded  that  information  high  in  the  structure 
(main,  or  superordinate  ideas)  is  more  likely  to  be  integrated  into  the 
learner's  cognitive  schema  than  information  low  in  the  structure  (details,  or 
subordinate  ideas). 

In  this  study  the  accuracy  of  student's  comprehension  monitoring 
during  computer-based  instruction,  and  the  relationship  between  enroute 
monitoring  and  different  levels  of  learning,  were  studied. 


METHODS 

Subjccli 

The  subjeas  were  50  university  undergraduates  enrolled  in  an 
introductory  educational  psychology  class  at  a  large  public  university. 
Subjects  participated  in  the  study  on  a  voluntary  basis  and  were  aw«rded 
eitra  credit  for  their  participation. 
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Mttefiali 

The  lesson  concerned  the  discovery  of  a  fictional  ore  (berkelium  oxide) 
on  an  imaginary  South  Seas  island.  Although  th»  details  of  the  material  were 
fictitious  in  order  to  avoid  the  influences  of  prior  knowledge,  the  content  was 
designed  to  avoid  logical  conflicts  with  concepts  pertaining  to  history, 
economics,  anthropology,  and  mineral  science. 

The  information  was  divided  into  four  sections  and  presented  in  the 
form  of  computer-based  instruction.  The  four  sections  were  The  History  of 
Jeiium  IsJMad,  The  Discovery  of  Berkelium  Oiide,  The  Miioiog  of 
BerJteJium  Qiide,  and  The  MerJtei  for  JterJtefium  Oiide.  The  average 
number  of  frames  per  section  was  1 1  with  a  maximum  of  13  and  a  minimum 
of  10.  Each  section  also  contained  two  graphic  drawings  which  were  used  to 
maintain  motivation,  but  did  not  relate  to  items  later  tested.  The  material 
was  designed  to  include  a  high  information  density  within  individual  frames 
and  sections  in  order  to  require  students  to  sort  among  numerous  facts  and 
concepts. 

Following  each  section,  students  ^  asked  to  rate  their  level  of 
understanding  of  both  the  factual  and  infet  viitial  material  on  ssales  from  one 
(not  at  all)  to  five  (very  weU).  They  then  answered  eight  short-answer 
embedded  questions  pertaining  to  the  material.  The  ei^ht  embedded 
questions  consisted  of  four  factual  questions  and  four  inferential  questions. 
Questions  following  each  section  covered  only  information  presented  in  that 
section  and  were  not  cumulative. 

Factual  Leiaon  Content 

Factual  questions  were  those  which  required  the  recall  of  information 
which  had  been  stated  explicitly  in  the  text.  The  questions  were  divided  into 
three  levels,  based  on  elements  common  to  the  parsing  hierarchies  of  both 
Meyer  and  ICintsch.  The  system  used  was  considered  more  appropriate  for 
the  individual  frames  of  computer-based  instruction.  Faaual  questions  were 
divided  into  three  Level  1  questions,  eight  Level  2  questions,  and  five  Level 
3  questions. 

Level  1.  Level  1  questions  were  the  most  general  and  could  be 
answered  with  the  main  idea  of  a  computer  frame.  An  example  of  a  level  1 
question  is:  "What  was  the  ore  Groningen  discovered?" 

Level  2.  Level  2  questions  were  more  specific  and  required 
information  which  supported  the  main  ideas.  An  example  of  a  level  2 
question  is:  "Why  was  the  discovery  of  the  ore  important  to  laboratory 
scientists?" 
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Level  3.  Finally,  level  3  questions  were  the  mos;  specific  and 
covered  deuils  which  were  less  significant  to  the  main  ideas  of  the  story. 
All  example  of  a  level  3  question  is:  "In  what  decade  did  Groningen  go  to 
Jexiuffl  Island?" 

Infcrgntiat  Lciion  Content 

Inferential  questions  required  students  to  evaluate  two  or  more 
related  pieces  of  information  in  order  to  form  a  conclusion.  The  questions 
were  divided  into  intrsframe  and  interframe  inferences.  Intraframe  and 
interframe  inferential  questions  were  distributed  evenly  across  sections. 

Intfaffaie.  Intraframe  inferences  could  be  answered  based  upon 
information  presented  in  a  single  frame.  An  example  of  an  intraframe 
question  is:  "What  important  event  occured  on  Jexium  Island  in  1945?" 

Interfftaie.  Interframe  inferences  required  that  information  from 
two  or  more  frames  be  evaluated  simultaneously  in  order  to  form  an 
appropriate  inference.  An  example  of  an  interframe  question  is:  "Who  built 
the  towns  around  the  mine  site?" 

Leiion  Poatteat 

There  were  a  total  of  32  items  on  the  posttest:  half  were  repeated 
from  the  lesson  and  half  were  new  items.  The  information  tested  using  the 
new  questions  was  evenly  divided  across  the  four  sections  and  contained 
equal  numbers  of  factual  and  inferential  questions.  Sixteen  of  the  questions 
were  factual  and  16  were  inferential,  yielding  four  learning  measures: 
Repeated  Facts,  New  Facts,  Repeated  Inferences,  New  Inferences.  One-half  of 
the  inference  questions  were  interframe  and  the  others  were  intraframe 
questions.  Three  of  the  factual  questions  were  Level  1,  seven  were  Level  2, 
and  six  were  Level  3-  The  items  were  presented  in  random  order.  All  test 
items  were  short-ansver  type  questions. 

Dependent  Meaaurea 

Several  dependent  measures  were  collected.  Dependent  measures 
related  both  to  students'  ratings  of  their  understanding  and  to  their 
subsequent  performance  on  both  embedded  and  posttest  questions  were 
collected. 

Separate  measures  were  obtained  for  fact  and  inference  ratings  for 
each  of  the  sections  of  the  lesson.  In  addition,  the  number  of  correct 
responses  to  embedded  factual  snd  inferential  questions  was  computed,  as 
well  as  an  aggregated  fact  and  inference  score  for  the  lesson. 

Student  performance  on  the  posttest  was  organized  in  two  ways.  First, 
correct  answers  were  tallied  to  produce  a  fact  and  an  inference  scale.  Next, 
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factual  items  vere  classified  as  Level  1,  Level  2,  or  Level  3,  and  inference 
items  were  classified  as  Interframe  or  Intraframe. 

Deiign  ind  DaU  Analyaia 

The  design  vas  a  complete  repeated  measures  design,  where  ail 
participants  received  exactly  the  same  instructional  treatment.  All 
dependent  measures  were  gathered  on  ail  students.  Regression  procedures 
were  conducted  to  determine  the  predictive  value  of  en-route  self- 
assessments  for  corresponding  factual  and  inferential  learning  both  for  the 
embedded  and  the  posttest  questions. 

Enroute  ratings  for  faaual  understanding  were  used  to  predia  student 
performance  on  embedded  faaual  questions  while  enroute  ratings  for 
inferences  were  used  to  predict  student  performance  on  embedded  inference 
questions.  Enroute  ratings  were  also  used  to  predict  posttest  performance 
for  each  corresponding  scale.  In  addition,  enroute  ratings  were 
intercorrelated  in  order  to  examine  the  relationship  among  ratings  for  facts 
or  inferences. 

Proccdufea 

All  students  received  the  same  treatment.  Students  reported  to  a 
microcomputtaf  lab  during  one  of  eight  periods  reserved  specifically  for  the 
study.  They  were  told  the  study  was  designed  to  investigate  how  well 
people  understand  material  presented  via  computer,  what  they  understand, 
and  how  well  they  can  evaluate  their  own  understanding.  They  were  also 
told  that  the  lesson  consisted  of  four  parts  with  approximately  10  frames  of 
information  contained  in  each  section  and  that  they  would  be  asked  short 
answer  questions  over  the  material  after  each  section.  This  information  was 
given  orally  at  the  beginning  of  each  session  and  also  repeated  at  the 
beginning  of  the  lesson.  Since  student  input  was  recordbd  during  the 
computer  program,  students  were  told  not  to  be  concerned  with  correct 
spelling,  but  to  confine  answers  to  a  single  line.  No  time  limit  was  imposed 
for  responding  to  the  questions. 

Students  then  completed  the  lesson.  During  each  section  they  viewed 
the  lesson  and  answered  the  eight  embedded  questions.  Students  did  not 
receive  any  knowledge  of  their  results  on  these  questions.  Following  all  four 
sections,  the  32  item  posttest  was  completed. 
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RESULTS  AND  DISCUSSION 

Piciual  EatiMi  wiili  Perforaance 

Factual  ratiiMS  cofreteted  with  e^b^Jded  icorei.  Table  i 
contains  oorrelations  between  students'  ratings  of  their  Tactual 
understanding  and  tbeir  scores  on  the  Tactual  questions  Tollowing  each 
section  oT  the  lesson.  Summed  across  sections,  the  total  Tactual  ratings  and 
perTori&wce  on  Tactual  embedded  questions  were  correlated  at  .30  <  .05). 
However,  most  of  this  correlation  could  be  accounted  Tor  by  perTormance  on 
the  Tourth  section.  During  the  Tirst  three  sections,  the  correlations  between 
ratings  and  perTormance  were  not  signiTicant.  Only  during  the  Tourth  seaion 
were  ratings  and  scores  on  Tactual  questions  signiTicanUy  correlated  at  .30  (£• 
<  .05). 


Insert  Table  1  about  here. 


This  could  indicate  that  students  improved  in  their  ability  to  rate 
understanding  as  a  result  oT  the  embedded  questions.  However,  although 
the  most  accurate  predictions  were  made  in  the  Tourth  section,  the  efTect  was 
not  progressive  during  the  Tirst  three  sections. 

Inta fcoff laUoM  amma  factual  ftinai  Table  2  contains 
correlations  between  ratings  oT  Tactual  understanding  in  each  of  the  Tour 
sections.  Factual  ratings  were  intercorrelated  Tairly  well  (minimum  <  .0 1 ), 
indicating  that  students  use  an  internally  consistent  system  to  rate  their 
understanding  oT  Tactual  inTormation.  but  that  the  system  was  not  as  highly 
related  to  their  actual  knowledge  oT  the  inTormation  tested. 


Insert  Table  2  about  here. 


Correlations  were  generally  highest  as  students  progressed 
chronologically.  SelT  ratings  Tor  Section  1  correlated  more  highly  with 
ratings  Tor  Seaion  2  (.55)  than  with  ratings  Tor  later  sections.  Ratings  Tor 
Section  3  correlated  highest  with  Section  4  (.59).  This  might  indicate  that 
adjustments  in  assessing  understanding  were  made  gradually  as  students 
progressed  through  the  lesson,  modiTying  their  aiteria  Tor  judgement  based 
on  experience  obtained  during  the  lesson. 
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FtCtlltl  fttimt  cofffUted  Wth  aostteit  acorei  Table  3 
contains  correlations  between  enroute  ratings  of  factual  understanding  and 
posttest  scores  on  questions  from  each  oi  the  four  sections.  Although 
students  perrormed  approximately  as  well  on  the  posttest  questions  as  on 
the  embedded  questions  (c  « .72.  st  <  .0001),  correlations  between  ratings  and 
scores  were  generally  lower  than  during  the  lesson  and  were  even 
negatively  correlated  in  some  instances. 


Insert  Table  3  abr  there. 


Facmal  ratiMi  correltted  with  levels  of  factual  flu»».tioiis 
Table  4  contains  correlations  between  ratings  and  performance  on  'ne  three 
levels  of  f  aa  questions.  Because  levels  were  not  evenly  distribut  id  among 
seaions  and  there  were  only  a  few  examples  of  ea«. .  level  within  a  se^'on, 
total  scores  are  use<^. 


Insert  Table  4  about  here. 


The  only  significant  correlations  wc^re  found  between  i'«ction  1 
ratings  and  performance  during  the  lesson  for  each  level.  These  correlations 
are  also  reflected  in  the  overall  correlation  between  Section  1  ratings  and 
total  score  shown  in  Table  1.  The  general  consistency  across  levels, 
especially  as  seen  in  the  total  ratings  correlated  with  level  lay  indicate  a 
consistency  in  ratings  across  levels  of  information.  Tt  slightly  lower 
correlations  for  Level  1  questions  throughout  may  be  accounted  for  by  the 
fact  that  there  were  simply  fewer  Level  1  questions.  Although  correlations 
with  Level  3  questions  on  the  posttest  were  slightly  higher  than  for  the 
other  two  levels,  they  were  generally  not  significant. 

Inference  RatiMi  witJi  Performance 

Inference  ratinaa  correlated  with  embedded  acorea  Table  5 
contains  correlations  between  ratings  of  inferential  understanding  and  scores 
cn  the  embedded  inference  questioiftimmed  across  sections,  the  total 
inferential  ratings  and  performance  on  inferential  embe^'  ^ed  questions  were 
correlated  at  .38  (fi  <  .01).  As  with  the  factual  correlations,  however  (see 
Table  1),  most  of  this  could  be  actuunted  for  by  performance  on  later 
sections.  The  general  trend  for  correlations  between  ratings  and 
performance  on  individual  sections  was  similar  to  the  trend  found  for  factual 
questions.   Initially,  correlations  were  low,  but  in  section  three  ratings  and 
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performance  were  significantJy  correlated  at  .37  (fi  <  .01).  However, 
correlations  declined  in  Section  4. 


Insert  Table  5  about  here. 


Intercorretatioai  aaona  inference  ratiaaa  Table  6  conUins 
correlations  between  students'  ratings  oT  inferential  understanding  in  each 
of  the  four  sections.  In  all  but  one  instance  (Section  3  with  Section  1). 
ratings  were  significantiy  interc9rrelated.  The  correlation  among  inference 
ratings  was  greater  than  for  performance  on  either  embedded  or  posttest 
inference  questions.  Again,  this  suggests  that  students  use  an  internally 
consistent  system  to  rate  their  understanding  but  that  this  system  is  not 
related  favorably  to  tested  knowledge. 


Insert  Table  6  about  here. 


Inference  rating  intercorrelations  exhibited  the  same  general  trends 
as  factual  rating  intercorrelations.  This  trend  may  indicate  that  students 
modify  their  criteria  for  self-assessment  based  on  lesson  experiences. 
However,  it  may  required  several  lesson  sections  to  form  a  reliable  system 
for  judging  inference. 

Inference  retimt  ooffelated  with  noatteat  acorea.  Table  7 
contains  correlations  between  enroute  ratings  of  inference  understanding 
and  posttest  scores  based  on  information  from  each  of  the  four  sections.  As 
with  factual  questions,  students  performed  approximately  as  well  on  the 
inference  posttest  questions  as  they  had  on  the  embedded  questions  (t  =  .71. 
Si  <  .000!).  The  trends  between  ratings  and  performance  varied,  howev-^r. 
from  embedded  questions  to  the  posttest. 


Insert  Table  7  about  here. 


Cc.  relations  were  strongest  between  ratings  and  performance  on 
Sections  1  and  4,  with  a  moderate  correlation  for  Section  3  and  virtually  no 
correlation  for  Section  2.  The  global,  seemingly  random,  relationships 
between  ratings  and  performance  were  typified  by  the  correlations,  obtained 
between  non-aligned  seaion  reatings  and  scores.  Significant  correlations 
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were  found  between  Section  4  ratings  and  Section  1  performance  (£  <  .01) 
and  between  Section  3  ratings  and  Section  4  performance    <  .03). 

infT  tnct  f  atinaa  corfliud  with  tyot  of  inf  f  net  aueati/in. 
Table  8  contains  correlations  between  ratings  and  performance  on  the  two 
types  of  inference  questions  (Interframe  and  Intraframe).  Because  there 
were  only  four  examples  of  each  question  type  per  section,  total  scores  were 
used.  Significant  differences  for  Sections  3  and  4  account  for  most  of  the 
correlation  between  ratings  and  scores  for  both  embedded  and  posttest 
questions. 


Insert  Table  8  about  here. 


Student  nerformanoe  on  en-route  inter  and  intra-frame  inferences 
was  very  similar  (61  %  and  63.73%).  It  is  therefore  unlikely  that  differences 
in  correlations  could  be  attributed  to  differences  in  performance.  St'«.dents 
appear  to  judg«  their  inference  comprehension  more  or  less  singularly,  and 
do  not  seem  affected  particularly  by  either  within-  or  interframe  influences. 

Fact  and  Inference  latiaga  by  Section 

Table  9  contains  intercorrelations  between  ratings  of  factual 
understanding  and  inferential  understanding  for  each  section.  Ratings 
within  sections  produced  the  highest  correlations  of  the  study  (.48,  .43,  .67, 
and  .78  respectively)  and  were  all  significant  at  the  .001  level,  despite  the 
fact  that  performance  on  fact  and  inference  questions  within  sections  did  not 
correlate  highly.  This  supports  the  assumption  that  although  students  were 
using  some  system  for  judging  their  level  of  understanding,  the  system  was 
not  highly  related  to  their  actual  knowledge  of  the  kinds  of  information 
tested.  The  system  also  did  not  differef^tiate  effectively  between  factual 
and  inferential  learning.  Rather,  boUi  la^i  and  inference  ratings  appeared 
rplated  to  some  global  criteria  on  which  students  based  their  assessments. 


Insert  Table  9  about  here. 


235 


Cognitive  Monitoring 
12 

GENERAL  DISCUSSION 

The  results  of  this  study  suggest  that  learners  are  not  good  judges  of 
their  en-route  comprehension.  Little  or  no  correlation  between  ratings  of 
understanding  and  subsequent  performance  for  both  faaual  and  inferential 
material  were  found  for  either  embedded  questions  or  the  posttest. 

One  possible  explanation  for  these  results  may  be  related  to  the 
subjective  nature  of  "understanding."  Students  may  assess  their 
understanding  according  to  criteria  different  from  one  another  as  well  as 
from  the  experimenter  (Baker,  1979;  Gamer  &  Anderson,  1982).  Though 
internally  consistent  both  within  and  between  ratings  for  fact  and  inference, 
the  ratings  are  not  related  well  to  any  of  the  scales  employed  in  this  study. 
In  addition,  the  more  or  less  random  correlations  with  the  different  levels  of 
factual  and  inferential  learning  suggest  that  the  student  ratings  were  not 
based  on  the  types  of  learning  addressed  in  this  study.  Ratings  appear  to  be 
based  more  on  the  undifferentiated,  global  perceptions  of  students  ns  to 
their  understanding.  This  presents  potential  problem  in  practice,  where 
the  specific  intended  lesson  information  may  not  be  the  basis  for  making 
learner-based  instructional  control  decisions.  Based  on  the  findings  of  the 
present  study,  it  is  simply  unclear  as  to  what  information  is  used  by 
students  to  estimate  comprehension. 

Some  degree  cf  acclimation  to  the  lesson  content  and  procedures  was 
presumed  necessary  before  self-assessments  could  be  oonside^^d  valid. 
After  several  sections  and  attempts  to  answer  questions,  student  ratings  of 
understanding  should  be  more  accurate,  and  sucoassive  ratings  more  highly 
correlated  with  actual  performance.  Although  this  pattern  was  not 
demonstrated  completely,  the  data  indicated  some  trends  in  this  direction. 
Correlations  between  ratings  aad  performance  for  both  factual  and 
inferential  questions  were  significant  mainly  in  later  seaioni;.  This  trend 
might  have  been  more  pronousvSd  if  understanding  of  factual  and 
inferential  questions  wer<»  more  consistent  across  students.  This  might  be 
accomplished  by  clarifying  the  rating  task  more  through  additional  initial 
instruction,  includidg  examples  of  factual  and  inferential  questions, 
specifying  explicitly  which  questions  were  factual  or  inferential,  asking 
students  for  ratings  of  specific  facts  or  inferences,  or  providing  response 
feedback. 

Individuals  may  also  evaluate  understanding  at  levels  other  than 
those  selected  in  this  sfudy.  For  example,  learners  may  assess 
understanding  correctly  at  low  levels  but  fail  to  demonstrate  understanding 
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at  a  higher  level.  Low  level  assessment  of  understanding  should  be 
reflected  in  higher  correlations  of  ratings  with  factual  questions  than  with 
inferential  questions.  It  was  expected  that  ratings  would  correlate  more 
highly  with  main  ideas  (gist  level)  than  with  lower  level  facts,  indicating  that 
students  based  their  assessment  on  knowledge  of  general  ideas.  The  data, 
however,  did  not  reflea  any  significant  relationships  between  assessment 
and  level  of  faaual  information. 

An  assessment  of  understanding  based  on  a  high  level  of  assimilation 
of  the  material  should  have  caused  ratings  to  b«  more  highly  correlated  with 
inferential  questions  than  with  factual  questions.  In  effect,  one  might 
predict  that  ratings  of  inference  would  be  the  best  predictors  of  student 
performance.  Again,  however,  this  was  not  demonstrated.  None  of  the  self- 
assessments  were  found  to  be  uniformly  more  accurate  than  others  in 
forecasting  student  performance.  Unfortunately,  ratings  were  not  highly 
correlated  with  performance  on  any  of  the  scales.  Instead,  there  were  only 
correlations  between  the  ratings  themselves.  Scores  on  both  the  embedded 
questions  and  the  posttest  indicated  that  students  remembered  high  level 
questions  best,  but  they  did  not  rate  their  level  of  understanding  based  on 
an  accurate  assessment  of  this  knowledge. 

Finally,  since  understanding  involves  the  integration  of  new 
information  with  prior  knowledge,  studies  which  are  relatively  short  and 
cover  only  a  small  amount  of  new  information  may  not  give  learners 
sufficient  time  to  develo  new.  or  to  adapt  existing,  schema  effeaively.  If 
an  inability  to  correctly  assess  understanding  is  related  to  the  lack  of  an 
integrated  cognitive  schema,  assessment  and  performance  should  improve  in 
later  sections. 

Cognitive  monitoring  can  be  particularly  difficult  to  study.  The 
process  can  only  be  inferred  from  observed  outcomes  and  from  the 
introspective  reports  of  subjects.  Subjects  who  lack  experience  with  the 
process  of  introspeaion  may  be  unaware  of  how  to  attend  or  what  the  focus 
of  the  attention  should  be.  The  resulting  reports!  may  reflect  processes  not 
anticipated  by  the  experimenter.  The  findings  of  this  study  may  be  related 
to  such  problems. 

The  popularity  of  learner  controlled  computer-based  instruction 
accentuates  the  importance  of  further  cognitive  monitoring  research.  The 
tendencies  reported  for  premature  withdrawal  from  CBI  lessons  may  be 
associated  with  basic  miiperceptions  of  learning.  The  lack  of  stronger 
correlations  between  self-assessed  understanding  and  aauai  performance 
indicates  the  need  for  further  rest. arch  in  this  area. 
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Table  1 

Ratings  of  factual  understanding  cofrelated  with  scores  on  factual  questions 
fcMT  each  section 


Seuhon  Score? 


Sect  1 

Sect  2 

Sect  3 

Sect  4 

Totol 

Sect  1 

25 

22 

.20 

17 

38** 

Sect  2 

11 

-  05 

.43** 

14 

23 

Sect  3 

-  02 

-  01 

10 

14 

07 

Sect  4 

02 

1 1 

33* 

30* 

.26 

Note.  Overall  fact  ratings  correlated  vith  fact  total  at  30,  g  <  05 
*p  <  05       **  p  <  01 


Table  2 

Intercorrelations  among  factual  ratings  aCTOss  sections 


Fact  Rati  ngs 


Sect  1      Sect  2      Sect  3      Sect  4 


Sect  1 

X 

55 

35 

44 

Sect  2 

•;  0001) 

X 

46 

47 

Sect  3 

(  01 ) 

(  001; 

X 

59 

Sect  4 

(  001 ) 

(  OOl) 

(  0001) 

X 
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Table  3 

Ratings  of  factual  understanding  cor f elated  with  scores  on  factual  oosttest 
Questions  by  section 


Po?ttsst  Scores 


Sect  1 

Sect  2 

Sect  3 

Sect  4 

Sect  1 

16 

-  03 

16 

.33* 

Sect  2 

12 

-  16 

20 

21 

Sect  3 

03 

-  16 

1? 

01 

Sect  4 

04 

-  03 

17 

05 

17 

Table  4 

Ratings  of  f aaual  understanding  correlated  with  scores  on  faaual  questions 
by  level 


Levels  of  Fact  Ouestion? 


Embedded  Totals 
1        2  3 

Posttest 
1  2 

Sect  1 

28* 

33* 

29* 

12  10 

29* 

Sect  2 

05 

17 

02  07 

22 

Sect  : 

-  02  - 

01 

1 1 

12   -  10 

11 

Sect  4 

07 

24 

24 

1 3  CO 

i9 

Total 

12 

r: 
c  J 

26 

1?  02 

*  2  '  05 
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Table  5 

Ratings  of  inference  understanding  correlated  with  scores  on  embedded 
inference  questions  by  section 


Section  Scores 


Sect  1      Sect  2 


Sect  4 


Total 


C7< 


a> 
c 


Sect  1 
Sect  2 
Sect  3 
Sect  4 


10 
06 
23 
2? 


14 

.12 
09 
.08 


25 

17 

,17 

12 

-  08 

10 

37** 

28 

49** 

30* 

24 

31* 

Note  Overall  inference  rating?  correlated  vith  inference  total  at  38,  ^  <  01 
*  g  <  05       **  p  <  01 

Table  6 

Intercorrelations  among  inference  ratings 


Inference  Ratings 


Sect  1      Sect  2      Sect  3      Sect  4 


C7' 


CO 


a' 
c 


Sect  1 
Sect  / 
Sect  5 
Sect  4 


V 

(  n'5) 
NSD 

(  01  ) 


29 

y. 

(  001) 
(  05) 


10 
45 

X 

(  0001 ) 


30 
49 
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Table? 

Ratings  of  inferenUal  underatanding  oorrelftted  vitli  scorea  on  inferential 
Dosttest  Questions  bv  section 


Posttest  Scores 


Sect  1 

Sect  2 

Sect  3 

Sect  4 

Sect  1 

30* 

25 

-.21 

03 

Sect  I 

06 

07 

08 

06 

Sect  3 

2  :> 

13 

24 

36* 

Sect  4 

41** 

02 

21 

34* 

*p 

<  05 

**  g  <  01 

Table  8 

Ratings  of  inference  understanding  correlated  with  scores  on  inference 
Questions  bv  tvoe 


Types  of  Inference  Questions 
Embedded  Totals  Postteat 


Inter 

Intra 

Inter 

Intra 

Sect  1 

24 

01 

04 

16 

IB 

a 

Sect  2 

1 1 

00 

06 

1 1 

1  nfer'en 

Sect  3 
Sec  4 

48*-^ 
26* 

37  ^ 
22 

26 
18 

36^* 
44** 

Total 

22 

:o 

*  t'  <  05  [I '  01 
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Table  9 

BattnQs  of  factual  understanding  correlated  with  ratings  of  inference 
understanding 


If) 


CkC 


4D 

u. 


5ect  1 
5ec'(  2 
Sect  3 
Sect  4 


Inference  Ratings 
Sect  1      Sect  2      Sect  3      Sect  4 


48**       07          30*  42** 

21          45**      34*  35** 

.02          29*        67**  41  ** 

.40**      .29*        49**  .78** 
*  p  ;  05       **  p  <  01 
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Today's  Information  managers  are  working  under  considerable 
pressures — pressures  that  are  unique  to  this  period  of  time  In 
our  Institutional  and  national  development.  Writers  such  as 
Alvln  Toffler  and  John  Nalsbltt  have  made  us  aware  of  the  on- 
going change  In  our  world  from  an  Industrial  nation  to  an 
Information  society.  The  roles  of  all  Institutions  are  In  the 
process  of  change.  New  technologies  are  available  to  assist  In 
providing  better  control  over  Information,  and  their  use  Is 
rapidly  being  adapted  to  a  wide  range  of  services  and 
operations — but  the  cost  Is  high.  These  high  costs  of  managing 
Information  have  come  about  at  a  time  when  Institutional  budgets 
are  considerably  leaner  than  they  were.  If  the  challenges  of 
this  new  information  society  are  to  be  met  head-on,  personnel 
costs  must  be  reduced.  This  means  that  along  with  the  new 
technological  time  saving  devices,  both  staff  and  management  will 
need  to  become  more  productive.  one  road  to  increased 
productivity  is  that  of  efficient  time  management. 
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A  study  on  time  management  practices  was  undertaken  among 
one  group  of  information  managers — the  directors  of  larcja 
academic  libraries— with  the  support  of  a  Librarian/Scholar  grant 
from  the  Council  on  Library  Resources.  Although  the  study  can 
only  be  ge'^eralized  to  other  groups  based  on  the  degree  to  which 
they  fit  the  description  of  the  population  surveyed,  the  results 
will  be  of  interest  to  all  types  of  information  professionals, 
including  those  in  media  services  and  telecommunications  who  work 
in  institutions  of  higher  education. 

Although  there  is  a  -:onsiderable  body  of  writing  and 
.research  on  the  subject  of  time  management  in  the  business 
literature,  little  existed  in  the  library  literature  that  dealt 
specifically  with  management.  A  survey  approach  was  deemed  the 
most  useful  method  to  generate  data  that  would  provide  insi^ht-.s 
useful  in  evaluating  time  management  practices  among  managers  of 
large  academic  libraries.  The  results  of  this  study  provided  a 
basis  for  evaluating  the  training  of  library  managers, 
determining  the  need  for  additional  research  in  the  field,  and  an 
opportunity  for  academic  library  directors  to  "ompare  their  own 
responses  to  those  of  others  in  similar  positions. 

Objectives  of  the  Study 

Four  objectives  of  the  study  were  designed  to  determine: 

1.  To  what  degree   library  'managers  are  aware  of  and 

pr.^uice  efficient  time  management  methods,  including 
delegation  of  authority  a-.J,  leadership  style. 

2.  Time  management  practices  ar  related  to: 

a.     leadership  style 
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b.  sex  of  manager 

c.  number  of  people  managed 

d.  years  of  experience  as  a  library  director 

3.  Identification  of  the  most  serious  time  wasters. 

4.  How  library  directors  reportedly  spent  their  time  based 

on  twelve  specified  categories. 

Sampling 

The  population  that  was  surveyed  consisted  of  189  directors 
from  large  academic  libraries.  Two  mailings  of  the  survey  were 
sent  out  to  ensure  at  least  a  60  percent  return.  The  final 
number  of  questionnaires  returned  was  159.  Since  the  entire 
population  of  directors  of  large  academic  libraries  were  polled; 
and  82%  of  them  responded,  we  may  for  all  practical  purposes 
consider  that  we  are  dealing  with  a  population  as  opposed  to  a 
sample  in  this  study. 

Da::a  Collection,  Analysis  and  Results 

Items  used  to  collect  the  data  in  the  mailed  survey  were 
based  on  the  time  management  literature,  ahey  fell  into  five 
categories:  1)  a  profile  of  the  respondents,  2)  how  a  manager»s 
time  is  reportedly  spent,  3)  delegation  of  authority,  4)  time 
wasterq  and  5)  leadership  style.  The  survey  was  pretested  using 
N  -  12. 

The  SPSS  statistical  package  was  used  to  analyze  the  data 
collected  from  the  survey.  Three  types  of  analyses  were 
calculated,  including  frequency,  Pearson  product-moment 
correlation  and  chi-scpiare  with  cross  tabulation. 

In  the  areas  of  che  academic  library  directc    profile  and 
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how  respondents'  time  waj  spent  (Tables  1  &  2),  the  results  of 
frequency  analysis  indicated  that  the  population  was  mature  both 
in  age  and  experience,  although  alaiost  half  of  them  (46.5%)  had 
been  in  their  current  position  five  years  or  less.  Most  of  them 
administered  staffs  under  300,  and  only  21%  of  them  were  female. 
They  spent  a  large  percent  of  their  time  involved  in  meetings  and 
with  committees  and  lesser  amounts  of  time  in  planning, 
reporting,  supervising,  budgeting  and  personnel  work.  Few  of 
them  spent  more  than  three  hours  a  week  on  external  fund  raising, 
but  55%  of  the  directors  spent  21  days  a  year  or  more  off  campus 
attending  professional  meetings  or  other  work  related  events. 


TABLE  1 

University  Library  Director  Profile 


Size  of  library  staff 

1-150  1 

Fl-300 

301-450 

451+ 

Percent: 

57.9 

31.4 

7.5 

3.1 

Number  of  years  in 
current  position 

1-5 

6-10 

11-15 

16+ 

Percent: 

46.5 

25.2 

15.7 

22.6 

Number  of  years  as 
a  library  director 

Percent: 

38 

17.7 

16.5 

27.8 

Number  of  years  as  a 
a  library  administrator 

Percent: 

6.3 

12.6 

16.4 

64.8 

Age 

23-35 

36-45 

46-55 

56+ 

Percent: 

.6 

22  .  6 

47.8 

28.9 

Gender 

MALE 
78.6 

FEMALE 
21.4 
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TABLE  2 


PERCENT  OF  TIME  SPENT  ON  MANAGEMENT  ACTIVITIES 


Hours  per  weeks 

1  0-3 

4-7 

8-11 

12-15 

16-19 

2  0+ 

Planning 

j  18.2 

46.1 

22.1 

11.7 

1.3 

.6 

Reporting  (internal 
&  external  coininuni- 
c^tions) 

1 18.5 

•i8.4 

22.9 

7.6 

2.5 

0 

Supervising 

156.8 

30.4 

10.1 

1.4 

.7 

.7 

Budgeting 

44.  8 

43.5 

9.1 

2  .  6 

0 

0 

Personnel  work 
(including  collective 
bargaining,  labor 
relations) 

42.2 

38.3 

14  .3 

3.9 

1.3 

0 

Meetings  with  univer- 
sity administrators 

49 

13.9 

5.1 

1.9 

0 

0 

Meetings  with  library 
administrators  (e.g. , 
assistant /a sftor* "i 

directors,  department | 
heads)  | 

3.9 

55.  5 

30.3 

8.4 

.6 

1.3 

Library  committees  | 

63 

30.5 

3.9 

0 

0 

Universitv  committees i 

J  .  O 

.  o 

.  6 

0 

External  fund  raising! 

69.1 

24.2 

4.7 

1.3 

.7 

0 

Number  of  days  per 
year  off  campus  for 
professional  meet-  | 
ings  or  work  related 
events  j 
Percent  | 

0-lG 
4.5 

1-20 
41.3 

21-30 
33.  5 

30+ 
20.6 

Delegation  of  authority  is  considered  an  all  important  skill 
in  the  management  of  time.  Information  about  how  knowledgeable 
the  respondents  were  about  the  delegation  of  authority  was 
collected  using  a  four-point  "agree-disagree"  Likert-type  scale 
in  response  to  a  series  of  statements  on  the  subject  (Table  3). 
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Eighty-five  to  90%  of  the  academic  library  directors  demonstrated 
good  to  excellent  knowledge  in  this  area.  The  two  statements  in 
which  fewer  of  them  responded  appropriately  for  an  effective 
delegator  had  to  do  with  permitting  staff  to  make  mistakes  and 
in  doing  tasks  that  their  subordinates  should  be  doing. 


3 

DELEGATION  OF  AUTHORITY* 


X.  I  frequently  allow  my  staff 
to  make  mistakes. 

2.  My  staff  make  most  of  the 
day-to-day  decisions  about 
thair  work  without  my 
prior  approval. 

3.  I  frequently  do  tasks  that 
my  subordinates  should  be 
doing. 

4.  The  libraiy  does  NOT 
function  smoothly  when  I 
am  absent. 

5.  I  seldom  revise  decisions 
made  by  my  staff. 

6.  I  give  my  library  staff 
considerable  authority 
over  work  (e.g.,  per- 
sonnel ,  finances , 
facilities    and  resources) 

7.  I  frequently  make 
decisions  that  are  part 

of   my    subordinates'  jobs. 


fcn  4J 
<  55 

AS 


A 


44  50.9 


t-i 

51 


to  to  |j 


Q  W 

DS 


13.8       49.7     29.6  6.9 


60.1         38         1.3  .6 


1.3       29.7     43.7  25.3 


.6         2.5     37.1  59.7 


28.9       59.7     10.7  .6 


9.5      55.1  35.4 


ERIC 


^51 


TABLE  3  (CONT'D.) 


•H 


AS 


A 


D 


DS 


8. 


I  delegate  most  library 
operations  to  my  sta^'f  • 


42.1 


51.6 


5.7 


,  6 


9.     If  I  were  incapacitated 
for  six  montts,  there  is 
someone  on  my  staff  who 
could  readily  take  over 
my  job  for  that  period 

of    time.  44.9      41.8      10.1  3.2 

10.  The  depaitment  heads 
under  my  leadership  do 
NOT  delegate  work  well 

to  their  own  subordinates.  1.3        9.2      64.7  24.8 

11.  My  key  people  take  the 
initiative  for  projects 
without  waiting  for  me 

to  think  of  them.  26.1      59.2        1.0  .6 


*  Percent  of  academic  library  directors  responding 


The  library  directors  who  answered  the  time  management 
survey  were  asked  to  rank  their  top  ten  time  wasters  out  of  a 
list  of  15.  This  list  was  then  compared  to  responses  to  the  same 
list  which  had  been  submitted  to  sales  repi <isentatives  and 
engineering  managers  in  fourteen  countries  by  Michael  LeBoeuf  and 
reported  in  the  February  1980  issue  of  Business  Horizons  (Table 


4)  . 
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TABLE  4 

TOP  TEN  TIME  WASTERS  RANKED  BY  THREE  OCCUPATIONAL  GROUPS 


Library 
Manager 

Attempting  too  much  at  once 
and  estimating  time 
unrealistically  1 

Cluttered  de  k  and  personal 
disorganization  2 

Confused  responsibility  and 
authority   

Crises  (personal  and/or  staff)  5 

Drop-in  visitors  6 

Inability  to  say  no   

Inadequate,  inaccurate,  or 

delayed  information  7 

Indecision  and 

procrastination   

Ineffective  delegation  and 
involvement  in  routine  and 
detail  g 

Lack  of  objectives, 

priorities  and  deadlines   

lack  of,  or  unclear, 
communications  or 

instructions  4 

Lack  of  self  discipline  lo 

Leaving  tasks  unfinished   

Meeting?,  (schetfuled  and 
unscheduled)  3 

Telephone  interruptions  8 


Sales 
Reps 


8 


Engineering 
Managers 


4 

2 


10 
3 
9 

5 
1 


6 
9 


8 


5 
10 
7 

4 

3 


Engineering  managers  did  not  rank  attempting  too  much  among 
their  top  ten  time  wasters,   and  sales  representatives  placed  it 
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near  the  bottom  of  thei.r  list.  Neither  sales  nor  engineering 
personnel  listed  a  cluttered  desk  and  personal  disorganization 
among  their  top  ten  time  wasters.  There  were  other  differences 
between  the  two  iuanagement  groups.  For  example,  library  managers 
indicated  better  control  over  the  telephone  than  engineering 
managers.  Library  managers  also  perceived  themselves  as  having 
fewer  problems  with  delegation  of  work  and  having  better  access 
to  information.  However,  there  were  mere  similarities  than 
differences,  which  are  born  out  by  a  low  positive  relationship 
between  the  two  groups  of  managers  with  a  correlation  of  .3045. 
On  the  other  hand,  a  very  low  negative  correlation  at  -.1755  was 
found  between  library  managers  and  sales  representatives. 

Much  has  been  written  about  leadership  style  over  the  yearn. 
In  the  beginning  there  was  an  effort  to  identify  the  traits  of  a 
leader.  Later,  researchers  in  the  field  of  industrial  psychology 
and  management  believed  that  leaders  were  either  process — that 
is,  people  oriented — or  they  were  task  oriented.  Today  there  is 
a  trend  toward  team  leadership  which  incorporates  both  aspects 
of  leadership — a  concern  with  high  productivity  and  a  concern  for 
people.  Based  on  the  Blake  and  Mouton  Managerial  Grid  model, 
five  possible  leadership  styles  were  identified  depending  on  how 
respondents  ranked  an  equal  number  of  statements  about  how  they 
dealt  with  conflict  (Table  5).  These  leadership  p^yles  are  based 
on  a  task-pro  ess  grid  that  i'ientifies  the  degree  to  which  the 
respondent  is:  primarily  concerned  with  getting  the  work  of  the 
organization  carried  out  (9,1),  primarily  concerned  with  the 
welfare  and  the  people  in  the  organization  (1,9),  concerned  with 
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neither  task  nor  people  (1,1),  equally  concerned  with  task  and 
process  (9,9),  or  at  some  midpoint,  balancing  between  either  task 
or  people  (5,5).  A  majority  of  the  academic  library  directors 
ranked  the  team  management  conflict  statement  as  the  one  that 
itiatched  their  most  typical  response.  Team  management  integrates 
both  task  and  people  concerns  in  a  leadership  style  that  works 
toward  developing  trust  and  committment  in  employees  in  an  effort 
to  foster  greater  productivity. 


TABLE  5 
LEADERSHIP  STYLE 
Rank  Conflict  Statement 


When  conflict  arises,  I  try  to  identify  reasons 
5  for  it  and  seek  to  resolve  underlying  causes.  (9,9) 

When  conflict  arises,  I  try  to  find  a  compromise 
4  that  everyone  will  be  satisfied  with.  (5,5) 

3  When  conflict  arises,  I  try  to  remair  neutral.  (1,1) 

I  avoid  causing  conflict,  but  when  it  does  appear,  I 
try  to  smooth  things  over  so  everyone  will  be  happy. 
2  (1,9) 

When  conflict  arises,  I  try  to  cut  it  off  or  win 
1  my  position.  (9,1) 


Correlations  were  run  for  all  variables  in  the  study. 
Although  soiue  writers  in  the  field  of  research  methodology  are 
critical  of  this  approach  and  regard  it  as  a  "fishing 
expedition",  there  are  advantages  in  this  type  of  a  study.  The 
results  of  the  Pearson  product-moment  correlation  were  for  the 
most  part  predictable.  Correlations  were  found  anong  the  nuirber 
of    years  the  respondent  had  be.en  in  a  management  position, 
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experience  as  a  library  director,  administrator,  including 
department  head  or  assistant/associate  director  and  age  (Table 
6). 


TABLE  6 
RESPONDENT  CHARACTERISTICS 


A  B 

C  D 

A.     Number  of  years  in 

current  position 

1               1  .7729 

.623     1  .5294 

J.     Number  of  years  as  a 

library  director 

1    .7729  1 

.5560   1  .4847 

C.    Number  of  years  as  a 

library  administrator 

1    .4626   1  .5560 

1  .4768 

incl.  dept.  head,  etc. 

1    .5294   1  .4847 

.4768  1 

D.  Age 

Correlations  among 

the  hours  spent  on 

meetings  with 

university   committees    and   the   time   spent  in 

meetings  with 

university  administrators  and  with  libra.y  committees  suggested 
that  the  meeting  style  of  university  administrators  may  provide  a 
role  model  or  organizational  style  for  the  subsequent  frequency 
of  committee  meetings  within  the  library  (Table  7) . 
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TABLE  7 

HOURS  SPENT  ON  MANAGEMENT  ACTIVITIES 


Hrs.  Spent  on  Meetings  with 
University  Committees 


Hrs.  spent  in  meetings  with  \ 

1 

university  administrators  | 

.3751  i 

Hrs.  spent  with  library  | 

committees  j 

.4864  1 

Correlations  among  the  delegation  statements  were  also 
predictable  with  those  respondents  whu  were  reluctant  to  give 
staff  authority  over  operating  decisions  perceiving  that  their 
library  would  not  run  smoothly  when  they  were  absent.  Those 
library  directors  who  did  not  feel  that  if  they  were 
incapacitated  for  six  months,  there  was  someone  on  their  staffs 
who  could  take  over,  were  more  inclined  to  make  decisions  that 
were  part  of  their  subordinates'  jobs  (Table  8). 


TABLE  8 


DELEGATION  OF  AUTHORITY 


A 

B 

C 

My  staff  make  most  of  the  day-to-day    i-.3807  |              |  | 
decisions  about  their  work  without        1              1              1  1 

I  frequently  do  tasks  that  my  | 
subordinates  should  do.                          |  I 

.5013 

I  seldom  revise  decisions  made  by          |  | 
my  staff.                                                 1  | 

i    .3667  1 

I  give  my  library  staff                          |  | 
considerable  authority  over                    |  | 
their  work.                                               |  | 

1.3716  1 

If  I  were  incapacitated  for  six             i  | 
months  there  is  someone  on  my                |  | 
staff  who  could  take  over.                     |  | 

-.3550 
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A:    The  library  does  NOT  function  smoothly  when  I'm  gone. 
B:     I  frequently  make  decisions  that  are  part  of  my  subordinates' 
jobs. 

C:     I  delegate  most  operations  to  my  staff. 


Chi-square  with  cross  tabulations  were  calculated  for  some 
of  the  data.  In  this  study  we  were  interested  in  the  existence 
of  significant  associations  among  the  respondent  characteristics 
and  the  variables  reflected  by  the  data  collected  in  Sections  II 
and  III  of  the  survey  instrument.  These  two  sections  dealt  with 
how  time  was  allocated  for  the  various  management  activities  and 
delegation.  Significant  associations  were  found  among  four  sets 
of  variables.  The  first  was  a  very  significant  association  at 
the  p  =  ,02  level  of  confidence  between  the  number  of  yea>-s  as  a 
library  administrator,  including  that  of  department  head  and 
assistant/associate  director  and  the  statement,  "The  department 
heads  under  my  leadership  do  NOT  delegate  work  well  to  their  own 
subordinates".  Those  who  responded  in  tua  "disagree"  columns 
were  more  frequently  academic  library  directors  with  fewer  years 
of  administrative  experience.  The  appropriate  response  to  this 
statement  for  an  effective  delegator  was  in  either  one  of  the 
"agree"  columns. 

The  age  of  the  academic  library  director  was  a  significant 
factor  in  two  cases.  The  age  of  the  respondent  was  a  highly 
significant  factor  in  the  number  of  days  spent  off  campus  at  the 
p  =  .0001  level  of  confidence.  The  older  the  director,  the  more 
days  he  or  sho  spent  off  campus  attending  professional  meetings 
or  work  related  professional  meetings  or  work  related  events. 
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Age  was  also  a  facto'  in  response  to  the  statement,  "I  frequently 
do  tasks  that  my  subordinates  should  be  doing".  A  significant 
association  was  found  between  the  age  of  the  acaderic  library 
directors  who  responded  in  the  "agree"  column  at  the  p  =  .01 
level  of  confidence.  The  most  frequent  respondents  wera  those 
who  were  56  years  of  age  or  older.  The  appropriate  response  to 
this  statement  for  an  effective  delegator  is  in  either  one  of  the 
"disagree"  columns. 

Gender  was  a  factor  in  the  number  of  hours  spent  on  library 
committees.  At  the  p  =  .001  level  of  confidence,  females  were 
found  to  have  a  highly  significant  association  in  the  amount  of 
time  spent  on  library  committee  work,  with  women  spending  more 
hours  on  this  activity  than  men. 

Conclusions  and  Recommendations 

The  implications  for  this  study  are  that  the  academic 
library  directors  who  responded  to  this  questionnaire  are 
experienced  and  mature  individuals  who  are  knowledgeable  about 
appropriate  delegation  skills  and  for  the  most  part,  team 
management  oriented  in  their  leadership  styles.  Their  selection 
of  the  top  three  time  wasters  helped  to  focus  on  those  areas  in 
need  of  attention.  The  first  concern  is  the  need  to  examine  the 
amount  of  time  spent  on  committee  work.  As  organizational 
structure  continues  to  evolve,  new  ways  of  dealing  with  decision 
making  and  work  flow,  other  than  the  committee,  must  be  developed 
for  greater  productivity,  without  the  director  falling  back  on  ar 
outmoded  authoritarian  style.  Second,  the  problem  of  taking  on 
too  much  work  at  the  same  time  should  be  addtessed.    This  problem 
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could  be  a  matter  of  more  effective  delegation;  however,  given 
the  results  of  the  study,  it  is  very  likely  that  it  has  more  to 
do  with  identifying  goals  and  establisning  priorities,  utilizing 
time  management  techniques  can  also  resolve  the  problem  of  the 
cluttered  desk.  Both  of  these  latter  two  time  wasters  are 
probably  the  outgrowLh  of  a  bureaucratic  organization,  such  as 
the  university,  where  committees  proliferate. 

Additional  research  into  these  assumptions  should  be  carried 
out,  including  the  effects  of  ^raining  decision  making  groups  in 
group  dynamics.  A  replication  of  this  study  with  other  groups 
may  also  prove  usefu? . 
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Several  text  format  variables  were  examined  in  at<  experiment  to 
identify  the  ways  in  which  these  variables,  under  specific  design 
combinations,  interacted.    Text  format  variables  are  those  elements 
used  to  create  legible  instructional  text.    The  variables  examined  in 
this  study  include  heading  location  (embedded  or  isolated),  line 
length  (long  or  short),  space  between  lines  (single  or  double), 
paragraph  indication  (indented  or  spaced),  use  of  running  heads 
(present  or  absent),  and  directive  cues  (present  or  absent). 

Sixty-four  computer  text  types  were  designed  using  all  possib-e 
combinations  of  the  six  bivariate  text  format  variables.     The  text 
types  were  presented  to  the  subjects,  who  sorted  them  into  seven 
normally  distributed  categories  (Q-sort  procedure)  based  upon  their 
perceived  study-ab? Mty .    Study-ability  was  operationally  defined 
as  the  rating  assigned  by  participants  to  models  of  computer- 
generated  text  based  on  the  perceived  ease  with  which  a  text  model 
could  be  read  and  studied  as  if  the  model  were  actual  tevt.  Data 
from  the  Q-sort  were  analyzed  via  a  6-way  repeated  measures  analysis 
of  vp'-iance.     Two  sign.f leant  (p  <.01)  5-way  interactions  were 
interpreted. 

Results  suggested  several  text  design  considerations.    The  presence 
of  a  running  head  was  a  preferred  desion  consideration  and  its 
interaction  with  the  other  variables  usually  served  to  improve  the 
study-ability  rating  of  the  text  type.     The  presence  of  directive 
cues  is  also  a  preferred  design  condition,  tending  to  improve  the 
rating.    While  double  spaced  text  was  preferred,  a  single  spaced  text 
with  running  head  and/or  directive  cues  would  be  preferre(^  more  than 
a  double  spaced  version  without  running  head  or  directive  cues.  The 
location  of  headings  had  the  greatest  affect  on  the  ratings,  probably 
because  it  had  the  most  noticeable  effect  on  the  image  of  the  text, 
though  its  affect  on  ratings  was  unpredictable.     The  more  organi^erj 
and  structured  appearance  of  the  spaced  paragraph  condition  probably 
combined  with  the  running  head  and  directive  cue  conditions  to 
produce  a  more  study-able  appearing  screen.     Line  length  did  not 
appear  to  be  a  significant  factor  in  the  stuuv-abi 1 i tv  ratings, 
though  all   things  being  e*'   el,  short   lines  were  preferred. 
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Relationships  Among  Text  Format  Variables 
In  Computer-Generated  Text 

Problem  Summary 

Text  format  variables  are  components  used  to  create  legible 
Instructional  text.    Some  examples  of  text  elements  used  within  the 
realm  of  a  cathode  ray  tube  display  (CRT)  Include  headings. 
Illustrations,  line  length,  leading  between  lines,  kern  between 
letters,  paragraph  Indication,  the  use  of  running  heads,  heading 
location,  directive  cues,  type  style,  type  size,  empty  space,  and 
graphic  devices. 

Initially,  legible  text  was  thought  to  be  a  function  of  the  size  and 
style  of  type,  therefore  research  concentrated  on  the  effects  of 
individual  symbols  upon  visibility  and  recognizabi  1  Ity.    A  synnbol 
considered  visible  was  considered  legible.    But,  as  more  was  learned 
about  the  processes  of  cognition  and  reading,  the  overall 
comprehensibi  1  i ty  of  Inst'^uct ional  text  was  considered  an  iTiportant 
element  of  legibility.    Legible  pages  or  screens  should  designed  to 
look  like  a  collection  of  ideas,  organized  and  understan^iabl e,  rather 
than  like  a  collection  of  letters;  they  must  flow,  and  be 
interpretable  as  well  visible  and  recognizable  (Ryder,  1979). 
However,  there  exist  no  formal  guidelines  for  the  design  of  screen 
layouts.    This  experiment  investigated  the  manner  in  which  several 
text  elements  interacted  when  specific  arrangements  were  judged  by 
percei  vers . 

Research  into  combinations  of  text  elements  presents  unique 
methodological  problems  for,  there  i almost  an  infinite  variety  of 
text  element  combinations.    For  example,  a  researcher  may  compare 
three  type  sizes,  two  line  lengths,  three  types  of  directive  cues, 
two  heading  locations,  two  paragraph  indications,  three  graphic 
organizers,  and  two  conditions  of  running  heads  creating  a  3  X  2  X  3 
X2X2X3X2  design  with  432  different  stimulus  combinations — not 
to  mention  the  irr^pl  ications  of  performing  a  7-way  analysis  of 
var  iance. 

In  an  effort  to  reduce  the  number  of  variables  to  a  manageable,  yet 
realistic  number,  the  chosen  text  elements  were  leading,  directive 
cues,  paragraph  indication,  running  heads,  heading  location,  and  line 
length. 

 Insert  Table  1  here.  


266 


Leading 


2 


Leading  was  defined  as  the  quantity  of  empty  space  between  lines  of 
text.    For  "paper"  publications.  Tinker  (1965)  suggested  that  under 
optimal  conditions,  In  terms  of  both  line  length  and  type  size,  the 
leading  between  lines  be  approximately  1.0  and  1.25  point  between  the 
bottom  of  the  descender  from  the  upper  line  and  the  top  of  the 
ascender  from  the  lower  line.    Hartley  (1978)  stated  that  the  leading 
should  be  equal  to  the  spacing  between  words,  an  amount  similar  to 
Tinker's  suggestion.    The  key  here  is  "optimal  conditions,"  for  when 
lines  are  extremely  long  more  leading  is  required  (Tinker,  1963). 

In  CRT  display  research,  Kolers,  Duchlncky,  rod  Ferguson  (1981)  foufid 
that  double  spacing  between  lines  of  text  on  a  CRT  marginally 
increased  reading  speed  over  single  spacing.    However,  they  also 
found  that  reading  single  spaced  text  required  less  occul ar  effort, 
because  more  densely  packed  text  requires  smaller  and  fewer  eye 
muscle  movements.    Grablnger  (1984,  1985)  found  that  percelvers 
preferred  double  spaced  text;  but,  this  preference  was  not  clear  cut 
and  appeared  to  Interact  with  other  text  element  variables.    The  two 
values  investigated  were  single  spacing  (51)  and  double  spacing  (52). 

Line  Length 

With  regard  to  line  length  as  a  format  variable,  Turnbul 1  and  Baird 
(1964)  recommended  that  lines  of  text  be  between  26  to  65  characters 
long  for  a  given  style  and  size  for  paper  displays.    Keenan's  (1981) 
research  with  CRT  displays  supports  this.    Keenan  used  a  computer  to 
determine  the  optimal  line  length  in  terms  of  meaningful  phrase  units 
for  different  readability  levels  and  found  that  line  lengths  in  the 
vicinity  of  45  to  55  characters  maintain  the  integrity  of  the 
greatest  number  of  idea  units.    Yet,  despite  this  research  designers 
often  persist  in  long  lines  of  text.    The  two  conditions  investigated 
were  60  (LL)  and  40  (SL)  character  lines.    Both  conditions  fall 
within  CRT  and  paper  standards,  yet  are  different  enough  to  create 
distinct  differences  am.:)ng  the  images. 

Directive  Cues 

The  use  of  directive  cues  is  one  of  the  few  format  elements  that  he 
had  a  positive  effect  on  some  types  learning  in  both  paper  and  CRT 
investigations.    Cues  such  as  underlining,  upper  case  letters,  or 
multicolored  text  have  Improved  recognition  and  recall  tasks  when 
used  sparingly  and  related  to  desired  outcomes  (Christ,  1975,  1977; 
Hartley,  Bartlett,  and  Branchwaite,  1980;  Tullis,   1931).  Perceiver 
reactions  to  directive  cuei.  die  harder  to  describe.     When  examined 
alone,  directive  cues  appeared  to  have  little  affect  on  preferences 
expressed  by  participants;  yet,   in  combination  with  other  text 
elements  the  cues  contributed  to  the  appearance  of  well  organized  and 
structured  designs  (Grablnger,  1984,   1985).    Since  a  wide  variety  of 
cues  have  been  found  to  be  effective,  the  main  question-,  are  related 
to  whether  cues  are  present  or  not  and  how  they  relate  to  other 
format  variables.    The  two  conditions  investigated  were  Cues  Present 
(CP)  or  Cues  Not  present  (CN). 


ERLC 


267 


Paragraph  Indication 


3 


The  shape  of  the  text  on  the  page  or  screen  can  be  changed  quite 
noticeably  through  paragraph  spacing  and  Indentation.    Efforts  to  use 
complicated  Indenting  patterns  to  represent  the  structure  of  the  text 
on  paper  displays  have  not  Improved  retention  or  recall  under  most 
circumstances  (Frase  and  Schwartz,  1979;  Hartley,  1980;  Shebllske  and 
Rotondo,  1981).    However,  It  has  also  been  found  that  readers'  design 
preferences  are  affected  by  spatial  changes  such  as  paragraph 
Indication  (SIskInd,  1979),  partly  because  the  text  may  look  more 
organized  and  strt^ctured  (Grablnger,  1984).    The  use  of  spatial  cues 
Is  a  highly  visible  format  factor  so  two  conditions  were 
Investigated:    Increased  use  of  white  space  (PS)  (double  or  triple 
spacing  between  p/»ragraphs)  and  traditional  Indentation  (PI). 

Running  Heads 

Hefnes  (1984)  recommended  the  use  of  a  format  variable  called 
hypertext,  or  running  head,  to  help  keep  readers  apprised  of  their 
location  In  a  lesson,  the  lesson  content,  their  progress,  and 
essential  computer  commands.    A  running  head  Is  recommended  because 
CRT  text  pages  are  short,  change  frequently,  and  the  nature  of  a  CAI 
lesson  often  prevents  easily  flipping  ahead  or  backward.    The  running 
heads  are  usually  placed  along  the  top  or  bottom  of  the  screen, 
though  may  also  be  found  along  the  sides.    Operationally,  this 
variable  took  two  forms:    present  (RH)  or  absent  (RHN). 

Heading  Location 

Heading  location  was  the  final  variable  included  in  the 
Investigation.    While,  the  use  of  headings,  particularly  in  question 
form,  has  facilitated  learning  (Hartley  and  T. ueman,   1982;  Hoi  ley, 
1981)  the  location       the  headings  affect  the  appearance  of 
organization  and  structure  of  the  page.    Since,  the  presence  of 
headings  has  facilitated  learning  it  was  decided  to  test  two 
conditions  that  affect  the  appearance  of  the  screen:    headings  were 
either  embedded  in  the  text  (HE)  or  isolated  in  a  separate  column 


Severe"  hypotheses  could  be  listed  that  would  predict  the  effect  of 
one  variable  and  one  condition  on  another.    However,  the  purpose  of 
this  study  was  to  explore  the  way  or  ways  in  which  these  variables 
interact  together.    The  purpose  is  analogous  to  examining  the  Gestalt 
of  the  screen,  to  inspecting  the  affect  of  the  whole  as  a  sum  of  its 
parts.     The  purpose  of  instructional  text  is  to  provide  material  that 
will  promote  learning;  therefore,   instructional  text  is  intended  to 
facilitate  an  interactive  cycle  between  the  learner  and  the 
stimulus.    The  basic  problem  is  the  identification  of  combinations  of 
text  element  variables  that  can  be  constructed  or  shaped  or  molded  hy 
text  designers  or  CAI  wri^-ers  in  ways  that  facilitate  the  learning 
process.  Or,  how  do  specific  combinations  of  variables  effect  each 
other? 


(HI). 


Research  Qjestlons 


ERLC 


a 

The  first  step  in  answering  that  question  was  to  determine  the 
initial  preference  reaction  of  a  potential  reader  to  specific  text 
designs.    Why  examine  preferences,  especially  since  preferences  a-  e 
often  unrelated  to  such  tasks  as  recall  or  retention?    First,  Tinker 
and  Pater son  (1942)  found  that  legibility  was  positively  related  to  a 
reader's  judged  pleasingness  of  the  text.    Tinker  (1965)  also  found 
that  readers  seldom  preferred  a  text  design  of  less  than  optimal 
legibility  and  tended  to  equate  pleasingness  with  legibility.  Bryant 
et  a1.  (1981)  discovered  that  preferences  affected  purchasing 
behavior  when  students  were  more  likely  to  purchase  textbooks  with 
illustrations  than  same  textbook  without  illustrations. 

A  second  reason  for  using  preferences  as  a  starting  base  is  the 
nature  of  the  perceptual  cycle.     If  it  is  accepted  that  legibility  is 
more  than  the  recognlzabi 1 i ty  of  a  symbol,  then  the  whole  cognitive 
cycle  (Neisser,  1976)  provides  ground  for  research.    The  combinations 
of  the  text  elements  becomes  more  Important  that  the  individual 
symbols,  because  the  potential  affect  of  the  initial  perception  of 
tho  document  upon  a  reader's  schema.    The  reader  n\ay  have  particular 
study  or  reading  strategies  that  are  activated  by  specif i'"  combina- 
tions of  format  variables 

In  conclusion,   i^  was  proposed  that  an  examination  of  a  "whole"  would 
shed  more  light  on  the  "parts"  than  an  examination  of  each  part 
separately.    The  variables  chosen  for  study  cover  a  range  of  design 
decisions  from  the  placement  of  white  space  to  cues  that  emphasize 
particular  words.    Highly  organized  and  controlled  designs  were  com- 
pared in  an  effort  to  identify  ways  text  format  variables  interacted. 


Hethodoiogy 

Sample 

This  was  an  opportunity  sample  composed  of  31  undergraduate  student 
volunteers,  all  single,  between  the  ages  of  20  and  25,  United  States 
citizens,  and  predominately  female. 

hater lals 

Sixty-four  computer  text  types  (see  Appendix  A  for  ^^amples)  were 
designed  through  the  use  of  different  combinations  of  six  bivariate 
format  variables.     To  avoid  confounding  the  treatment  with  contextual 
factors  the  text  tvpes  were  designed  using  the  notat  ion  method 
(Twyman,   1981).     In  place  of  actual  text,  "X"s  were  used  to  represent 
the  bulk  of  the  print  on  a  page?:  "0"s  to  reflect  the  occurrences  of 
italics,  upper  case,  bold  type,  color,  headings,  or  reverse  type;  and 
"T's  as  a  tertiary  graphic  unit  to  represent  something  particularly 
unique  in  style.     As  a  result  of  participant  comments  in  the 
Grabinger,   1984  study  the  standard  use  of  the  notation  method  was 
altered  slightly  by  incorporating  spaces  to  rrake  groups  of  "X'*s  loow 
mere  like  words  in  actual  text.    Althougt^  it  can  be  suggested  that 
the  use  of  the  notation  system  rpduces  ecological  validity,   it  is 
argued  here  that  its  use  emphasizes  the  image  of  the  page  as  whole 
visual  entity.    Each  page  was  designed  on  an  IBM  PC  computer  with  the 
Hultlmate  word  processor  program.     The  stimuli  pages  were  printed 
on  a  dot -matrix  printer,  enlarged  on  a  photocopy  machine,  and 
Q  laminated  for  durability. 
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Eliciting  Preferences 

The  text  types  were  presented  to  the  subjects  together  with 
discriminating  and  sorting  Instructions  to  elicit  perceptions  about 
their  study-ability.    Study-ability  was  operationally  defined  as 
the  rating  assigned  by  participants  to  models  of  computer-generated 
text  based  on  the  perceived  ease  with  which  a  text  modet  could  be 
read  and  studied  as  If  the  model  were  actual  text. 

Utilizing  recorded  Instructions  (see  Appendix  B),  subjects  were  asked 
to  perform  an  unstructured  Q-sort  of  the  64  text  types  or  stimuli. 
The  Q-methodology  was  used  because  of  Its  usefulness  In  exploratory 
research,  in  turning  up  new  Ideas  and  hypotheses  (Kerllnger,  1973). 
Subjects  sorted  the  stimuli  Into  seven  plies  In  quantltlef  that 
reflected  a  normal  distribution.     In  this  sorting  procedure,  the  four 
textr  perceived  to  be  the  highest  In  study-ability  were  plared  in 
pile  I,  while  those  four  perceived  to  be  the  lowest  were  placed  In 
pile  7.    From  the  remainder  of  the  text  types,  those  eight  believed 
to  be  the  highest  in  study-ability  were  placed  In  pile  2  and  those 
eight  considered  to  be  of  the  lowest  In  pile  6.    ""he  forty  stimuli 
left  over  were  allocated  among  the  remaining  inner  three  piles  with 
the  12  believed  to  be  the  highest  in  study-ability  placed  in  pile  3 
and  the  12  lowest  in  pile  5.    The  remaining  16  were  placed  in  the 
middle  or  fourth  pile.     After  completion  of  the  sorting  tasK  the 
participant  was  interviewed  about  the  criteria  used  during  the  task. 
Responses  were  written  down  by  the  experimenter.    Participants  we^e 
shown  the  first  pile  and  asked,  "Why  did  /ou  rate  these  the  highest 
on  the  study-ability  factor?"    Then,  they  were  shown  thei*"  seventh 
pile  and  asked,  "Why  did  vou  rate  these  trit  lowest?" 


Results 

The  matrix  presented  in  Table  2  depicts  the  raw  data  arrangements  of 
64  CRT  text  types  generated  by  the  sortings  of  the  subjects  in  the 
sample.    A  single  value  in  each  column  is  a  rating  of  the  relative 
study-ability  of  ti^e  respective  text  as  perceived  by  the  particular 
subject,  represented  in  the  row  of  the  ma'Tix.     This  data  was 
analvzed  via  a  repea^^^l  measures  analvsis  of  variance  (BMDP,  1981), 
A  conservative  .01   level  of  significance  (sugge  ted  by  Ker linger, 
1973)  was  accepted  to  offset  the  the  dependence  that  may  result  amonn 
stimuli  during  the  Q-sort.     The  main  ANOVA  results  are  presented  in 
Table  3. 

 Insert  Tahle  2  here.  


 Insert  Tahle  3  here.  

rhp  primary  ANOVA  produced  two  significant  interactions  among  the 
tpvt  element  variables  for  further  analysis.     These  were  the  ^'running 
hprid  by  heading  location  by  cues  bv  spacing  betv^en  lines  by  line 
lj=»ogth"  interaction  (RHCSL)  and  the  "running  head  by  cues  by  snaring 
bv  line  ^?igth  by  paragraph  indication''  (RCSLP)  interaction. 
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One  way  of  analyzing  a  multiple  interaction  Is  by  Isolating  the 
interactions  at  each  level  or  order  (Keppel,  1982).     In  this  way  we 
can  look  at  each  variable  under  constant  conditions.    This,   in  turn* 
produces  a  set  of  n^argirial  means  that  may  be  used  to  graph  the 
Information  In  a  way  that  allows  one  to  spatially  Inspect  the 
results.    This  is  accomplished  via  further  ANOVAs.    Foi  example*  the 
first  step  in  the  RrlCSL  analysis  was  to  determine  which  condition  of 
the  Line  Length  variable  was  interacting  with  the  other  variables. 
ANOVAs  were  run  holding  the  conditions  of  RHCS  variables  constant 
under  both  Line  Length  conditions  finding  that  the  short  line  length 
(LS)  value  contributed  to  the  fnt<=»racclon  (see  Figure  1).  Next, 
Double  and  Single  Spacing  were  compared  while  holding  RHCL  constant. 
This  process  was  continued  for  all  five  variables  In  the 
interaction.    The  ANOVA  tables  are  not  printed  because  there  are 
several  hundred.    The  resui 's  of  this  '^sl  Iclng-off"  process  for  both 
five-way  interaction?  are  presented  In  Figure  I. 

 Insert  Figure*  1  here.  


 Insert  Table  4  here.  

RHCSL  Interaction 

The  variable  conditions  running  head  present  (RH),  directive  cues 
present  (CP),  single  spacing  (SI),  short  lines  (LS),  and  embedded 
headings  (HE)  contributed  to  the  interaction.     This  in  itself  teMs 
little,  but  by  taking  the  marginal  means  of  the  study-ability  ratings 
(see  Table  4)  the  interaction  can  be  "mapped  out"  in  a  series  of 
graphs  to  aid  interpretation  (see  Figure  2).    By  comparing  the  graphs 
of  the  RHCSL  interaction  the  fc! lowing  statements  can  be  made: 

 Inseri  Fi      ?  2  here.  

1.  The  presence  of  a  running  head  in  a  design  was  always 
preferred  over  the  same  design  with  no  running  head  (Figures 
2a  to  2h) . 

2.  The  presencp  of  directive  cues  were  preferred  over  no 
directive  cues  (compare  2a  and  2b,  2c  and  2d,  2e  and  2f,  and 
2g  and  2h) . 

3.  Short  M^es  were  preferred  over  long  lines  (compare  2a  and 
2e,  2b  and  2f.  2r  and  2g,  and  2d  and  2h). 

4.  Double  spacing  was  usually  preferred  over  single  spr3Cing 
(compare  2a  and  2c,  2b  and  2d,  2e  and  2g,  and  2f  and  2b). 

*^ .    Generally,  it  seems  that  isolated  headings  and  directive  cues 
work  together  to  produce  favorable  designs.     It  seems  tha^" 
r»)rective  cues  played  an  important  role  with  the  heading 
location.     De^^igns  using  both  directive  cues  (CP)  and 
isolated  headings  (HI)  were  favored  over  those  with  embedded 
heer^ings  (HE)  and  directive  cues  (Figures  2a,  2c,  and  2e). 
However,  when  directive  cues  were  not  present  (CN)  the 
embedded  heading  designs  were  preferred  over  the  isolated 
heading  designs  (Figures  2b,  2d,  2f,  and  2h). 
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6.  The  Interaction  of  heading  location  with  the  running  head 
condition  Is  difficult  to  predict.    The  most  visible  change 
in  a  design  combination  Is  found  in  Figure  2e.    The  blending 
of  isolated  heading,  running  head,  cues,  single  spacing  and 
long  lines  was  significantly  preferred  over  designs  with 
embedded  headings,  with  and  without  »"unnlng  head.  However, 
in  Figure  2d  the  Isolated  heading  condition  combines  with  the 
no  running  head  (RHN)  condition  to  improve  the  appearance  o^ 
the  design. 

7.  Though,  comparison  of  Figures  2e  and  2g  show  that  isolated 
headings  were  favored  in  a  single  spaced  layout  while  in  the 
same  layout  with  double  spacing  embedded  headings  were 
preferred. 

8.  The  most  preferred  design  combination  was  composed  of  running 
heads,  isolated  headings,  cues,  double  spacing  and  long  lines 
(see  Figure  2c) . 

9.  The  least  preferred  design  combination  was  composed  of  no 
running  heads,  isolated  headings,  no  cues,  single  spacing, 
and  short  lines  (see  Figure  2f). 


RCSLP  Interaction 

The  significant  variables  found  in  the  RCSLP  ir^teraction  were  running 
heads  present,  directive  cues  present  and  absent,  single  spacing, 
long  lines,  and  indented  paragraphs  (see  Figure  I).     The  following 
statements  can  be  made  about  the  variables,  based  on  Figure  3: 

 Insert  Figure  3  here.  

1.  Designs  with  a  running  head  (RH)  were  alwavs  preferred  over 
designs  with  no  running  heads  (PHN)  (Figures  3a  to  3h). 

2.  Double  spacing  (52)  was  preferred  over  single  spacing  (51) 
(compare  3a  and  3b,  3c  and  3d,  3e  and  3f,  and  3g  and  3h)  . 
Note  especially  graphs  3c  and  3d  where  the  spacing  between 
lines  has  a  oramatic  effect  under  the  running  head  (RH), 
short  line  (LS)   indented  paragraph  condition  (PI). 

3.  5paced  paragraphs  (PS)  were  preferred  over  indented 
paragraphs  (PI)   (compa'^e       and  3e.  3b  ana  3f,        and  3g,  and 
3d  and  3h). 

4.  There  seemed  to  be  a  general  prefe'^ence  for  long  line^  (LL) 
over  short  lines  (uS)  (compare  3a  and  3r,  3h  and  3d,  3p  and 
3g.  and  3f  and  3h) . 
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5.  The  presence  of  directive  cuss  (CP)  was  preferred  over  the  no 
cue  condition  (CN)  (compare  graphs  3a  through  3h).  Figures 
3a,  3c,  3e,  3g,  and  3h  show  the  significant  effect  of  cues 
over  no  cues.    The  cues  seemed  especially  sensitive  to  the 
running  head  condition  (CP-I?HN).    When  the  both  cues  and 
running  heads  were  absent  from  designs  the  dis3pproval  went 
up  further  than  when  the  running  head  was  present  without 
cues  (CN-RH)  (Fig  res  3a,  3c,  3d,  and  3h). 

6.  In  Figures  3d  and  3e  the  absence  of  a  running  head  had  far 
greater  Impact  on  the  design  than  did  the  absence  of  cues 
under  double  spacing,  short  lines,  and  indented  paragraph 
combination. 

7.  The  most  preferred  design  combination  included  running  heads, 
cues,  double  spacing,   long  lines,  and  spaced  paragraphs  (see 
Figure  3f ) . 

8.  The  least  preferred  design  combination  included  no  runninr. 
heads,  no  cues,  single  spacing,  short  lines  and  indented  " 
paragraphs  (see  Figure  3c). 


Discussion 

In  terms  of  study-ability  preferences  for  images  of  text,  the  impli- 
cations for  design  are  many.     However,  since  the  effect  of  these 
designs  on  achievement  has  not  yet  been  established  mo  generalization 
in  that  direction  shoulc'  be  made. 

The  use  of  a  --unning  head  is  one  of  the  most  stable  results  of  the 
study.    No  design  combination  without  a  rui.ning  head  was  preferred 
over  designs  with  a  running  head.    Although  ii-  interacted  with  other 
variables  in  affecting  preference  its  interaction  was  always  in  a 
positive  direction. 

The  presence  of  cues  as  a  prefer  ed  element  in  text  design  was  also  a 
fairly  stable  influence.     The  use  of  cues  seemed  to  improve  the 
study-ability  rating  in  all  situations  except  one  (Figure  3d.  running 
head  (f.H)  line).     It  could  be  that  that  particular  combination 
produced  the  simoiest  and  most  spacious  design,   looking  very  easv  to 
read  and  study. 

Another  fairly  consistent  trend  was  fo..nn  in  .hr  preference  for 
double  spaced  text  over  single  spaced  text.    However,  upon 
examination  of  the  i nte.-act ions  it  was  found  tnat  spacing  was  easily 
influenced  by  other  factors.    For  example,  the  absence  of  a  running 
head  had  greater  impact  on  the  st.dy-abi 1 ity  rating  than  did  spacing 
when  comparing    igures  3g  and  3h  (compare  the  RHN  dot  in  eaci 
graph).    While  subjects  orobabl"  preferred  the  more  spacious  look  of 
double  spaced  text,  ti- -  spacing  of  the  text  did  not  seem  as  important 
in  making  a  study-ablncv  judgment  as  cues  or  running  heads.  t;,,s 
suggests  th^t  desigr  features  that  affect  the  organ izat  on  and 
hierarchical  structi  re  of  the  text  are  more  important  t  an  the 
appearance  of  spaciousness. 


ERIC 


273 


9 


Long  lines  were  preferred  over  short  lines,  though  rhis  did  not  seem 
to  be  Q  strong  preference.    Ffgurp  2  shows  this  to  a  greater  extent 
than  Figure  3.     This  is  probably  due  to  the  heading  location 
conditions  in  Figure  2  which  may  have  emphasized  the  difference 
between  the  two  line  length  conditions. 

The  usual   interaction  between  line  length  and  line  spacing  did  not 
seem  to  occur.     This  may  be  explained  by  the  narrow  difference 
between  the  two  line  length  conditions  since,  both  the  40  character 
line  and  60  characxer  line  fell  within  legibilit/  recommendations. 

The  affect  of  the  heading  conditions  wa*^*  widely  variable.    Tnis  fnay 
be  due  to  the  radical  effect  heading  position  has  on  the  text  design, 
since  it  changes  the  margins,  body  of  the  text,  and  overall  image 
more  than  any  other  change. 

The  affect  of  paragraph  indication  is  cons i stent ,  though  not  great. 
Generally  the  spaced  paragraph  condition  was  preferred  over  indented 
paragraphs.     Its  interaction  with  other  variables  was  positive  but 
slight.    The  only  unusual   incident  is  seen  in  Figures  3a  and  3e. 
Here  the  paragraph  condition  appears  to  interact  with  cues  and 
running  heads.     In  Figure  3a  there  is  a  wide  difference  between  cues 
present  and  the  two  running  head  conditions.    Figure  3e  shows  a  wide 
disparity  between  the  two  running  head  conditions  in  the  no  cues 
condition.    The  more  organized  and  structured  appearance  of  the 
spaced  paragraph  condition  probably  combines  with  the  running  head 
and  directive  cues  to  produce  a  more  study-able  appearing  screen. 


Gen'^rally,  although  the  variables  discussed  combine  to  interact  when 
influenrino  preference  for  studying  they  are  for  the  mos .  part 
predictable.     A  designer  that  fo Mowed  a  practice  of  utilizing 
running  heads  as  general  organizers,  spaced  paragraphs,  and  a  few 
directive  cues  for  emphasis  would  probably  create  pages  or  screens 
that  produce  a  more  positive  opinion  about  study-ability  within 
potential  readers.     Though  the  most  preferred  design  in  the  RHCSL 
interaction  hari  isolated  headings,  the  position  of  headings  is 
orobably  not  as  critical.     The  effect  of  no  headin'.is  on  a 
stLjdv -abi  1  f ty  rating  would  probably  be  greater.     While  it  appears 
that  rpaders  prefer  double  spacing  anci  long  lines,  these  factors  did 
not  a,  >ear  to  contribute  as  much  to  the  studv-abi 1 i tv  of  the  document 
rjs  the  other  variables. 

i^/hile  preference  is  related  to  '  QihiMtv,  thp  ultimate  test  is 
learning.  Remaining  questions  include  tn^  effpct  o^  these  designs  on 
ip'-irning  and  the  activaiion  of  ^earning  st  rat  e'^ii  , 
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ApprndiM  B 
Inttructlont  to  th«  Subjtctt 


You  Mill  txaiint  tivtral  «odtlt  uf  coiputtr-gtntr attd  ttxt.  Thete 
4rt  iodelt  of  ttxt  that  ity  bt  tttn  on  coiputtr  ttltvlilon  tcrttnt 
Mhtn  using  coiputtr^Attitttd  instruction. 

Btfort  you  btgini  look  at  toit  of  tht  ttxt  iodili  in  front  of 
you.    Nott  that  thty  art  coapostd  of  'X"t  and  '0*'t.    Tht  *X*t 
rtprtttnt  tht  body  of  tht  ttxt.    Tht  *'0't  rtprtttnt  Mordt  that  art 
sptcial,  tuch  at  htadings  or  tubhtadingt.    On  soiit  of  tht  aodtlt  you 
Mill  ttt  thrtt  9ttt  of  'X"t  that  art  darktr  than  tht  rttt  of  tht 
ttxt.    Thttt  dark  tttt  of  "X*t  rtprtttnt  Mordt  that  aay  bt  in 
italics,  bold  typt,  or  undtrlintd.    Finallyi  tott  of  tht  aodtlt  havt 
a  box  at  tht  top  of  tht  pagt.    This  box  it  calltd  hyptrtsxt  and 
contains  a  suaaary  of  tht  conttnt  of  tht  Itsson  and  a  list  of 
coaputer  coaaands  that  aay  htlp  tht  Itarntr  during  tht  Itsson. 

Hhtn         txaaint  tht  ttxt  aodtlt  tvaluatt  tach  aodtl  on  a 
factor  calltd  "itudy-ability. •    •Study-ability*  rtftrs  to  both 
rtadability  and  Itarning  characttri sties.    For  txaaplt,  a  ttxt  aodtl 
Mith  a  high  "study-ahUity*  factor  would  apptar  tasy  to  rtad  and  tasy 
to  study.    On  tht  other  hand,  a  ttxt  aodtl  nith  a  low  *'study-ab i  1  i ty" 
factor  would  apptar  hard  to  rtad  and  hard  to  study.    You  art  tht 
judgt  of  what  apptars  tasy  or  hard  to  rtad  and  study.    Thtrt  is  no 
right  or  wrong  answtr.    Tht  btst  answtr  it  whattvtr  you  dtcidt.  Look 
at  tach  aodtl  and  ask  yourself,  Mf  this  were  actual  text  would  I 
find  this  style  easy  to  read  and  study  or  hard  to  rtad  and  study''* 

Sort  tht  64  aodfis  of  coaputtr-gtntrattd  ttxt  into  stvtn  pilts 
according  to  the  ""study-abi  1 1 ty "  factor.    Rtaeaber  to  base  your 
Judgements  on  how  tasy  tht  aodtl  apptars  to  study  as  if  tht  aodtl 
were  actual  text.    Use  the  sorting  procedure  described  as  foUows: 

In  Pile  No.  1,  place  tht  4  ttxt  aodels  that  have  tht  highest 
"study-ability*  factor.     Ia  Pile  Nc.  7,  place  tht  4  ttxt  aodtlt  that 
have  the    J/itst  "study-ability-  factor.    Unt  way  tj  do  this  is  ta  go 
through  tie  text  aodels  sorting  then  into  high,  nadiua,  and  low 
"study-ability"  pilts.     Thtn  return  to  the  •^high"  pil;}  and  find  the 
tour  with  the  highest  "study-ability**  rating  and  pUce  thea  in  Pile 
No.         Then,  go  to  the  Mow"  pile  and  find  the  four  with  the  lowest 
•*5tudy-ability"  rating  and  place  thta  in  Pilt  No.  7. 

Hfter  placing  aodels  in  pile  nuabers  1  ^nd  7  there  will  be  S6 
aodels  left.    Place  all  of  the  aodels  togtther  and  repeat  the  sorting 
procedure.    Place  the  8  with  tht  highest  "study-abi I i tv"  rating  in 
Pile  No.  2  and  the  6  with  the  lowest  "stuly-ab i I i t y "  rating  in  Pile 
No.  6. 

Then  thtrt  w.ll  be  40  ttxt  aodtls  remaining.    Place  all  of  tht 
models  together  again  and  rt-sort  ^he/n.     Froa  these  40  aodels  place 
the  12  with  highest  "study-ability"  rating  in  Pile  No.  3  and  the  12 
with  lowest  rating  in  Pile  No.  5. 
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Th^rt  Mill  thffn  bff  16  modtls  Itft  and  thty  are  ill  plicffd  in 

Pilff  No.  4. 

Tht  nuabtr       tht  text  aodtli  to  bt  pltctd  in  t«ch  pilt  tlto 
apptarf  on  tht  pile  identification  cardt  or.  ''he  table  in  front  of 
you.    you  eav  rearrange  the  aodelt  until  you  are  tatitfled  Mith  their 
placeaentv  but  aake  sure  you  place  the  specified  nuaber  of  text 
iodelt  in  each  pile. 

you  lay  refer  to  thetc  inetructione  or  atk  the  experieenter  for 
help  whenever  you  with.  Finally,  reeeaber  to  Judge  each  «odel  on  hoM 
easy  it  appears  to  study  as  if  it  Mtre  actual  text. 


Ttbli  1 


Variablii 

Usfld  in 

Stiauli  Difian 

Lead  i  rq  s 

(SI ) 

finals  iQACinn 

(S2) 

doublt  fpicing 

Oirectivi  Cutss 

(CN) 

no  directive  cu«f  prtstnt 

(CP) 

dirtctivt  cu«i  prtstnt 

Paragraph  Indicationi 

(PI) 

indtnttd  piraqraph 

(Pa) 

ipictd  ptragriph 

Running  Htad: 

(RHN) 

no  hyptrttxt  prticnt 

(RH) 

hypertext  present 

.leading  Position: 

(HE) 

embedded  heidingi 

(HI) 

isoiited  headings 

Line  Length! 

L'  • 

long  (60  character)  line 

(Suy 

short  (40  character)  lint 
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lable  2 


Ran  Data  flatrix 


Subjects 


16  17  16  1?  20  21  22  23  24  25  26  27 

'  Q 

^7  Ol 

3 

1 

2 

4 

4 

3 

2 

1 

3 

2 

4 

6 

T      T  i 
Z      ^  4 

1 

2 

2 

4 

2 

4 

1 

3 

,^ 

2 

c 

1     0  1 

6 

5 

4 

4 

2 

5 

3 

2 

^ 

0 

«;    T  T 

J     £  0 

7 

3 

3 

5 

2 

b 

2 

4 

2 

2 

7 

6 

7 
J 

I     J  0 

7 

\j 

2 

4. 

7 

i 
1 

3 

1 

2 

3 

3 

5 

J 

^     1  0 

t 

1 

2 

3 

3 

2 

3 

i 

2 

T 

4. 

4 

5 

i 
1 

\     1  k 
J     Z  1 

3 

2 

3 

2 

3 

2 

3 

4 

2 

3 

4 

2 

7 

1      1  <i 

4 

4 

3 

2 

3 

3 

3 

4. 

/ 

2 

4 

3 

1 

1     J  S 

3 

T 

A. 

7 

6 

4 

4 

5 

4 

5 

3 

1 

S  1 

Jit 

1 

3 

4 

5 

7 

ij 

4 

5 

7 

5 

2 

7 

J 

6 

5 

1 

7 

T 

3 

3 

3 

5 

4 

6 

4 

0 

117 

1     1  >> 

J 

3 

3 

5 

4 

4 

a 

5 

6 

^ 

7 

ij 

7     4  'J 
J      1  A 

7 

•J 

4 

2 

4 

4 

1 

4 

3 

c 

J 

4 

3 

5 

1 

«.     1  0 

i. 

3 

3 

4 

5 

3 

3 

5 

3 

3 

5 

7 

0 

T  7 
0     0  0 

1 

J 

4 

3 

5 

3 

5 

5 

4 

3 

4 

1 

2    I  5 

4 

3 

4 

3 

4 

5 

3 

5 

3 

3 

3 

3 

4 

2   4  4 

3 

2 

1 

3 

2 

4 

I 

3 

2 

1 

6 

1 

3 

4  3  1 

3 

2 

3 

3 

2 

4 

*) 
i. 

3 

2 

*) 

6 

3 

4 

5  2  4 

5 

1 

4 

5 

1 

7 

1 

6 

7 

7 

7 

4 

7 

6   4  3 

5 

3 

3 

3 

1 

6 

2 

4 

*) 

1 

7 

4 

f 

2 

3  3  1 

4 

3 

1 

i 

2 

1 

*) 

; 

L 

1 

3 

4 

1 

L. 

5 

^   0  2 

5 

4 

2 

1 

1 

4 

1 

6 

:  3  3 

4 

5 

i. 

1 

1 

3 

2 

5 

1 

3 

4 

4 

4 

6  2  6 

5 

T 

1 

1 

1 

1 

4 

i 

1 

4 

2 

c 

■J 

5  3  5 

4 

3 

4 

4 

4 

4 

5 

5 

5  4  5 

3 

c 

J 

3 

3 

4 

3 

c 

1 

A   4  2 

7 

4 

6 

3 

4 

6 

4 

4 

6 

6 

7 

6   7  7 

6 

4 

5 

3 

4 

6 

4 

3 

6 

2 

3  5  2 

4 

3 

5 

4 

3 

4 

5 

4    4  4 

4 

4 

4 

7 

5 

4 

3 

3 

3 

4 

4   4  3 

5 

3 

4 

4 

n 
i. 

4 

6 

4 

4 

7 
J 

5 

5 

7   0  6 

c 

J 

5 

7 

4 

4 

4 

7 

4 

3 

4 

3 

4 

4  5  6 

Text 
Text 
Text 
Text 
Text 
Text 
Text 
Text 
Text 
Te/t  10 
Text  11 
Te^t  12 
Text  13 
Text  14 
Text  15 
Text  io 
f-t  17 
>>t  18 
Text  I? 
Tei^t  20 
Text  l\ 
Text  22 
Text  2 J 
Text  24 
Text  :5 
Text  26 
lext  27 
Text  23 
Text  29 
fext  30 
Text  31 
Text  >j2 


3  3  5 

3  2  I 

3  5  6 

3  2  7 
2  1  4 
2  3  3 
2  5  4 
2  2  2 

4  6  4 


2  3  7 

1  2  5 

2  4  7 

1  6  6 

3  4  4 
3  3  5 

2  3 


4  3  3 

4   6  6 

4   3  2 

4   4  5 

7 


4 

4  3 

4  4 

2  1 


3 
4 

4 

1 

5  4 

4  : 

1  2 

i  4 

4  I 

5  6 

5  6 

6  6 


1  4 

1  2 

5  4 

3  2 

4  5 

3  3 

4  3 

4  : 

3  1 

5  i 

7  0 

4  I 

3  3 


5  4  H 

4  1  4 

4  :  ! 

2  2  2 

5  4  : 

«-  7  7 


5  5  4 

4  1  3 

5  5  4 

6  3  1 

2  6  3 

3  5  1 
^  5  3 

3  5  2 
5  5  4 

2  1  3 
5  3  5 

4  2  4 

3  6  5 
2  5  5 
1  3  4 

0  J  3 

4  1  3 

1  5  2 
^  2  4 
4  3  3 


1 
4 

7 
6 
4 
7 
4 
5 
6 

3  6 

4  5 


5  2 

3  2 

6  5 

4  5 

5  1 

4  1 

5  4 
4  2 

4  3 
2  2 

5  6 


4  4 

7  5 

4  3 

4  1 

3  2 

5  4 
7  4 

4  3 
3  3 


3  3  1 

3  4  2 

3  2  I 

3  5  4 

2  3  1 

2  3  2 

1  6  1 

2  6 
6  4 

5  3 

6  5 


2 
4 
4 
4 

J  J  5 

4  4  3 

5  3  4 
5   5  4 

4  5  5 

3  1  2 
3  I  2 
3  4  2 
3  4  3 
3  3  2 
I  2  2 
3  fa 

3  6 
t  3 

5  2 

4  5 

5  4 

4  : 
4  : 


5  \ 

6  4 


4  4 
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Table  2  Continued 
R'M  Data  flatrtx 


Subjects 

I  2   3  4  5  6  7  8  9  10  11  12  i:  i,  15  16  17  IB  19  20  21  22  23  24  25  26  27  28  29  30  31 


Text  33  3  4  4  3  5  6  6  6  2  5  5  5  4  3  5  2  4  5  7  4  5  4  3  4  5  5  6  5  6  3  5 

Text  34  3  2  4  2  5  5  2  2  2  2  3  5  4  3  4  1  4  4  \  4  5  j  2  4  4  5  5  3  3  4  4 

Text  35  5  5  7  3  6  6  5  6  4  6  7  5  7  5  4  6  5  6  7  3  3  5  4  4  5  5  7  6  5  7  5 

Text  36  5  4  4  3  5  6  2  5  3  2  6  5  5  5  5  5  4  5  5  6  6  5  4  4  4  5  4  2  2  5  4 

Text  37  3  4  5  4  7  4  3  7  5  5  3  1  2  3  6  2  4  4  2  7  2  4  2  3  5  2  6  1  5  2  7 

Text  38  5  3  3  4  4  5  2  6  3  4  3  4  4  4  4  2  4  4  2  7  5  4  1  3  4  2  5  3  4  3  4 

Text  39  3  5  5  5  4  5  3  4  3  4  4  2  5  4  4  4  5  6  3  6  3  4  4  3  5  3  4  4  2  4  4 

Text  40  5  4  2  4  4  <  1  3  2  4  4  2  6  4  3  4  5  5  3  5  4  5  4  3  4  3  5  3  5  5  5 

Text  41  7  4  6  2  6  6  6  5  6  5  5  7  4  4  2  2  6  5  5  6  4  6  5  7  6  4  4  5  4  4  4 

Text  42  7  3  3  2  5  5  6  2  4  I  5  7  3  3  I  1  4  5  5  6  6  5  4  7  6  4  4  2  6  5  3 

Text  43  7  7  7  5  6  6  6  6  5  7  7  7  7  6  3  6  6  7  7  4  6  7  4  7  6  5  7  6  7  5  4 

Text  44  7  3  2  5  5  6  5  2  4  2  6  7  7  5  1  6  6  6  6  5  7  7  4  7  6  4  2  2  2  6  2 

Text  45  666474446434444r55473656716465!j 

Text  46  6  4  3  4  7  5  4  4  5  1  3  4  3  4  2  2  7  5  4  5  4  6  3  6  6  4  6  4  3  6  ! 

Tex;  47  6  4  3  5  5  5  5  4  4  5  4  4  5  6  2  4  6  7  4  5  3  0  5  6  6  2  4  1  3  5  5 

Te;t  48  6  4  4  4  5  4  5  4  4  1  4  4  5  5  2  4  6  7  4  5  5  6  5  6  6  2  3  4  3  6  4 

Text  49  3  5  5  6  6  3  6  3  5  4  5  4  2  4  4  4  5  5  3  3  4  4  3  4  5  5  4  4  7  2  5 

Text  50  3  2  3  4  5  3  2  2  2  2  5  4  I  3  4  3  4  4  3  3  5  4  2  4  4  5  4  3  3  3  2 

Text  51  5657646456756737505465645577676 

Text  52  5  2  4  6  5  4  4  2  3  3  6  3  4  6  3  6  4  6  5  4  6  4  4  4  4  5  2  2  3  5  2 

Text  53  5  4  4  4  4  I  3  4  2  4  3  I  2  3  6  3  4  4  2  5  2  4  2  3  5  2  4  6  4  3  4 

Text  54  5  5  3  5  4  2  4  4  2  2  3  2  2  3  5  4  4  4  2  4  2  5  2  3  4  2  3  5  4  3  3 

Text  55  3  5  5  6  4  2  3  7  4  5  4  2  6  ?  5  5  5  5  I  4  3  5  6  3  5  3  5  5  5  6 

Text  56  3  6  ^  6  4  3  5  6  3  6  4  2  4  5  3  5  4  4  3  5  5  5  4  3  4  3  *  5  4  4  5 

Text  57  5  7  !}  6  4  3  5  3  7  4  5  fa  3  6  3  4  7  5  0  4  4  5  5  5  6  4  3  5  5  5  5 

Text  56  5336534262567623456545555423463 

Text  59  ^  7  7  7  6  4  7  3  7  7  7  6  6  7  3  7  6  7  6  6  6  7  7  5  7  4  7  7  7  7  7 

Text  60  6  3  I  7  5  4  6  3  6  3  6  6  5  6  2  6  6  6  6  5  7  7  5  5  5  4  3  2  6  5  2 

Text  61  5  ^  4  5  7  i  5  4  5  2  4  4  3  6  3  4  6  5  4  6  I  5  6  6  7  1  4  5  4  6  4 

Text  62  5  3  4  3  4  2  5  4  4  1  3  4  I  3  ;  4  5  4  4  6  4  6  3  6  5  1  4  6  4  4  3 

Text  63  6  7  5  7  4  ^  4  7  6  :  h  3  4  7  '  5  6  4  5  4  6  7  o  7  2  "  4  5  5  7 

Text  64  6  6  5  4  3  7  4  5  6  4  6  4  7  I  5  7  6  4  fc  6  6  7  6  5  2  5  5  6  5 


283 


Table  3 

Repeated  Heasures  ANOVA  of  CRT  Text  Hodels 


Source 


Sues  of  Degrees  of  flean 
Squares     Freedoi  Square 


Tail 
Prob. 


Hean 

1  Error 

RngHd 

2  Error 


3 1 720 . 00454  1  3 1 72C. 00454    S992498 .00    0. 0000 

0.13609  30  0.004S4 

'''^^  64970  1  373.64970          21.42  O.OOOl 

:)^3. 30343  30  17.44345 


Hdngs 

3  Error 

RngHd  X  Hdngs 

4  Error 


0.84728 
347.66835 

0.18196 
23.02117 


1 

30 

1 

30 


0.84728  0.07  0.78P7 
11.58894 

0.18196  0.24  0.6298 
0.76737 


Cues 
5  Error 


236.50454 
464^44859 


1  236.50454  15.28  0.0005 

30  15.48162 


RngHd  X  Cues 
6  irror 


0.36744 

25.52319 


3u 


0.36744 

{;.8?077 


0.43  C.5161 


ridngs  t  Cues 
7  Error 


13.72228        i  13.72228  12.16  0.0015 

33.85585       30  1.12853 


RngHd  I  hdngs  t  Cues  2.00050  1 

8  Error  26.64o!2  jO 


2.00050 
0.88a0(J 


2.25     0  1435 


Spcg 
9  Prror 


64.23841 
429.65222 


3u 


64.23841 
14.26841 


4.j0  0.0424 


RngHd  X  Spco 
10  Error 


4.35937 
28.34375 


30 


4.35937 
0.94479 


4.61  0.0399 


Hdngs  I  Spcq                     5.77067  1 

11  Error                             54.24496  30 

RngHd  I  Hdno-  a  Spcg          0.84728  1 

^•ii-ror                             27.  10585  30 


5.77067 
1.80817 

0.84728 
0.90353 


3.19  0.0841 


0.V4  0.3406 


Cues  I  SpcQ 
13  irror 


0.48437 
35.96875 


30 


0.48437 
1.19996 


0.47  0.5299 
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RngHd  I  Cues  I  Spcg  0.00050 

14  Error  16.99012 

Hdnns  X  Cues  t  Spcg  2.39970 

!5  error  20.72843 

RngHd  i  Hdngs  t  Cues  t  Spcg  2.00050 

16  Error  20.64012 


3C 


0. 00050 
0.5630U 


1  2.39970 

30  0.69761 

1  2.0005U 

30  0.68800 


U.OO  0.9763 


3.44  0.0735 


2.91  0.0985 


Table  3  (continued) 


Source 


Sues  of  Degrees  of  Kean 
Squares     Freedoi  Square 


Tail 

Prob, 


Lgth 
17  trror 


237,88760 
259.00302 


1 

30 


237.887W) 
8.63343 


27.55  0.0000 


RngKd  t  Lgth 
18  in  or 


0.SJ437 
32.21875 


1 

30 


0.48437 

1,07396 


0.45  C.5070 


Kdngs  I  Lgth 
19  Error 


19,96018 
63.68044 


1 

30 


19,96018 
2.12268 


9.40  0.0046 


RngHd  t  Hdngs  I  Lgth  4,17389 
20  Error  12.15423 


30 


4.17389 
0.40514 


10.30  0.0032 


Cues  K  Lgth 
21  trror 


0.42389 

25,02923 


30 


0.42389 
0.83431 


0.51  0.4815 


RngHd  X  Cues  t  Lqth  0.93196 
22  Prror  23.45867 


30 


0.93196 

U. 78196 


1.19  0.2837 


Hdngs  t  Cues  t  Lgth  1.52470 
23  Error  15.17843 


30 


1.  ^470 
0.50595 


3.01  0.0928 


RngHd  X  Hdngs  t  Cues  I  Lgth  0.00454 


24  ^^^o^ 


13.2610? 


30 


0.00454 
0.44204 


0.01  0.9200 


Spcg  t  Lgth 
25  Error 


12.74244 
42.64819 


30 


12.74244 
l.42i6l 


8.96  U.0055 


RngHd  I  SpcQ  I  Lgth  0.26663 
26  Trror  14.43649 


30 


0.26663 
0.48122 


0.55  u.t624 


Hdnas  X  Spcg  X  Lgth  26.43196 
27  irror  49.20867 


30 


26.43196 
1.64029 


16.11  0.0004 


RngHd  ;  Hdngs  I  5pcQ  I  Lgth  1.M34I 
28  irror  14.46472 


1.11341 
0.482:6 


2.31  0.1391 


Cues  X  i>,  X  Loth  0.31502 
29  irror  15.63810 


30 


0.31502 
0.52127 


0.60  0.4430 


RngHd  I  Cues  x  Spcg  l  Lgth  0.02470 
3ti  Error  23.865S5 


30 


0.0247U 
0.79553 


0.u3  0.8613 


hdngs  X  Cues  K  Spcg  t  Lgth  0.26663 
31  irror  26.43649 


30 


0.26663 
0.88122 


0.3o  0.5863 
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R  «  H  x  C  X  S  i-  L  2.98841 
3:  Error  11.52722 


30 


2.98841 
0.IP424 
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7.78  0.0091* 


Tablff  3  (continued) 


Source 


Sues  of  Degrees  of  Kean 
Squares     Freedoi  Square 


Tail 
Prob. 


far  a 
33  Error 


136.81302 
218.13810 


1 

30 


136.61502 
7.27127 


18.81  0.0001 


RngHd  t  Para 
34  Error 


9.46018 
26.05544 


1 

30 


9.46018 
0.86851 


10.89  0.0025 


Hdngs  X  Para 
35  Error 


0.31502 
37.13810 


1 

30 


0.31502 
1.23794 


0.25  0.6176 


RngHd  I  Hdngs  X  Para  0.69002 
36  Error  21.70060 


30 


0.69002 
0.72335 


0.95  0.3365 


Cues  X  Para 
37  Error 


5.14163 
27.87399 


I 

30 


5.14163 
0.92913 


5.53  0.0254 


RngHd  X  Cues  X  Para  2.26260  1 

39  Error  24.94052  30 


2.2626C 
0.83135 


2.72  0.1094 


Hdnas  X  Cues  X  Para  1.63760  I 

39  Error  16.87802  30 


1.63760 
0.56260 


2.91  0.0983 


RngHd  X  Hdngs  X  Cues  X  Pdra  3.47228 


40  Error 


18.85585 


1 

30 


3.47228 
0.62853 


5.52  0.0255 


Spcg  I  Para 
41  Error 


57.24244 

107.58569 


I 

30 


57.24244 
3.58619 


15.96  0.0004 


RngHd  X  Spcg  X  Para  2.68599  1 

42  Error  Ik. 70464  30 


2.68599 
0.4?"^49 


6.34  0.J174 


Hdngs  t  Spcg  X  Para 
43  Error 


0.01260 
36.56552 


30 


0.0126'.' 
i. 21885 


0.01  0.9197 


RngHd  X  Hdngs  X  Spec  X  Fara  0.54889 
44  Error  ll.:i673 


0.54939 


!.4'  ').::5i 


Cues  X  Spcg  t  Para  3.30696 
45  Error  24.58367 


3.3O0-0 


4.04  .,)53c 


Rngild  I  Cups  i  3prq  x  para  IT. 74:44 
46  Error  !4.B:56^ 


i:/4:44 
..4945: 


:5." 


Hdngs  •  Cues  I  5pca  i  Para  0.j4a?^ 
17  Irro'^  10.^  9i:v7 


'.545r^ 


.211: 


ERLC 


45  :rrcr 


4.  1738'' 
J4.5:9:: 


4.173S^ 
.61 'c4 


j.l"  u.('3i3 
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Table  3  (continued) 


Source 


3ui5  of  Degrees  of 
Squares  Freedo* 


Mean  Tail 
Square  F  Prob. 


Lqth  t  Para 
49  irror 


2.0O050 
31.32762 


1 

30 


2.00050 
1,04425 


1.92  0.1765 


RngHd  t  Lgth  I  Para  0.02470  1 

50  Error  15.61593  30 


0.02470 
0.52053 


0.05  0.8290 


Hdngs  \  Lgth  I  Para  5.77067  1 

51  ^^ro^  22.43246  30 


5.77067 
0.74775 


7.72  0.0093 


RnqHd  X  Hdngs  I  Lgth  I  Para  1.21016  1 
5?  Error  9.6B044  30 


1.21018 
0.32268 


3.75  0.0623 


Cues  t  Lgth  I  Para  2.12954  1 

53  Error  20.01109  30 


2.12954 
0.66704 


5.19  0.0841 


RngHd  t  Cues  I  Lgth  K  Para  1.11341  1 
54  Error  22.96472  30 


1.11341 
0.76549 


1.45  0.2372 


Hdngs  I  Cues  I  Lgth  t  Para  3.30696  1 
55  £rror  11,95867  30 


3.30696 
0.39862 


8.30  0.0073 


R  X  H  X  C  X  L  X  P  0.93196  1 

56  Error  14.39617  30 


0.93196 
0.47987 


1.94  0.1737 


Spcg  i  Lgth  i  Para  6.21018  1 

57  Error  39.24294  30 


6.2iuie 

1.30810 


4.74  0.O373 


RngHd  K  Spcg  X  Lgth  K  Para  2.00050 
58  Error  12.76512 


30 


2.U0050 
0.42550 


4.7y  0.0382 


Hdngs  t  Spcg  I  Lgth  X  Para  2.00050  1 
5?  Error  18.32722  30 


2.00050 
0.62759 


3.19  0.0843 


R  X  H  X  S  X  L  X  F 
60  Error 


0.42389 
2U. 34173 


30 


0.42389 
0.69472 


0.61     (1.  4408 


Cues  X  SpcQ  X  Lqth  X  Para  0.06099 


61  Error 


12.95464 


1 

3u 


(J.:)609V 
0.43182 


0.14  0.7097 


F  X  C  X  S  X  L  X  P 
62  Error 


4.94002 
15.51310 


4.94002 
U. 51710 


=.55  0.0043* 


H  X  C  X  S  X  L  X  P 
63  irror 


1.63760 
21.50302 


1.6376U 
u. 71677 


2.28  0.1411 
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R  X  H  X  C  X  S  X  L  X  p  0.61744 
64  Error  15.33569 


30 


U  61744 

0.51119 


1.21     0.  2805 
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Figure  1 

Variable  Conditiont  and  Interactions 


Condi  ti  ont 

RHCSL 
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Running  Head;  present  (RH) 
abient  (RHNI 
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Directive  Cues:  present  (CP) 
abtint  (CN) 
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X 
X 

Spacing  (Leading):  single  (SI) 

double  (S2) 

X 

X 

Line  Length:  long  (LL) 
short  (LS) 

X 

X 

Heading  Location:  eibedded  (HE) 
isolated  (HI) 

X 

Paragraph  Indication;  indented  (PI) 
K 

spaced  (PS) 

X  ■  This  condition  was  preferred  significantly  eore  than  the  other  in 
the  specified  coibination  of  text  element  variables. 
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Figure  2 
RHCSL  Inttr«ction 


Figure  2a 
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Figure  2b 
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Figure  2  (continued) 
RHCSL  Interaction 


Figure  2e 


Figure  2f 
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Figure  2g 


ERLC 


6.5-- 
6.0-- 
5.5 
5.0-- 
4.5-- 
4.0 


RHCSL 


CP  -  52  -  LS 


f?H 


Figure  2h 
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Flgurt  3 
RCSLP  Inttrftction 


Figure  3c  Figure  3d 


Figure  3  (continutd) 
RC8LP  Inttriction 


Figura  3b  Figurs  Zi 
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Table  4 

Rarginal  Means  of  Study-ability  Ratings 
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Running  Running 
Heads  Heads 
Present  None 

Heading  Heading 
Locat.  Locat. 
Eibed  Isolate 

Direct.  Direct. 
Cues  Cjes 
Present  None 

Spacing  Spacing 
ainqie  Double 

Length  Length 
Long  Short 

Paragr.  Taraqr. 
Indent  Spaced 

3.565 

3.290 

3.581 

2.968 

3.323 

2.613 

4.194 

4.000 

3.000 

2.935 

2.806 

3.065 

3.000 

3.903 

3.548 

4.532 

3.065 

4.258 

l.il3 

3.903 

3.581 

3.613 

3.548 

3.726 

3.710 

3.595 

3.121 

3.121 

2.B39 

3.238 

3.419 

3.774 

3.065 

3.113 

2.613 

?.44b 

2.581 

3.613 

3./ (4 

uit 

4.069 

4.177 

3.839 

3.161 

4.516 

5.i2? 

3.903_ 

3.960 

3.548 

5.581 

3.516 

4.371 

4.419 

4.323 

4.432 

4.421 

4.141 

4.419 

4.016 

4.4S4 

3.548 

4.823 

S.2vO 

4.355 

3.863 

3.790 

!.87i 

3.710 

3.935 

4.000 

3.871 

4.944 

4,548 

5.339 

4.50! 

4.194 

6.000 

4.677 

4.468 

4.742 

4.194 

4.452 

4.484 

4.419 

4.444 

4.060 

4.266 

3.758 

4.258 

4.7/4 

3.968 

3.855 

3.419 

3.452 

■  .,■  3.?B/ 

4.290 

4.837 

4.827 

4.^06 

4.645 

4.065 

4.387 

5.226 

5.129 

EXTENDING  GRADUATE  LEVEL  EDUCATION:     A  MANAGEMENT  MODEL 
by  Robert  L.  Hales  &  Stephen  B.  Felt 

Goals  and  Qbjectlveg 

Project  Goal:  To  develop  a  delivery  system  that  is  capable  of 
transferring  prof essional r  graduate-level  education  programs 
having  identical  content  to  those  presented  on  university 
campuses  to  adult  audiences  off  campus.  The  model  must  be 
inexpensive^  flexible^  easy  to  u&e^  and  capable  of  a  high  degree 
of  educational  transfer. 

Cur  original  search  for  technology  to  facilitate  the  delivery 
system  included  both  video  and  audio  formats.  Since  video 
cassette  players  are  not  universally  available^  we  turned  to 
audio  cassette  technology.  It  offered  the  following  advantages 
for  distance  education: 

1.  Universal  availability 

2.  Low  cost  for  players  and  cassette  tapes 

3.  Portabilityr  ease  and  convenience  of  use 

4.  Independence  from  broadcast  schedules  and  bad  weather 

5.  Learner  control  of  place  and  time  of  information  transfer 

We  felt  that  these  attributes  would  be  significant  in  using 
technology  as  a  bridge  to  carry  courses  to  distant  students  and 
to  extend  the  influence  of  our  most  popular  and  capable  faculty. 

A  review  of  the  literature  indicates  that  distance  education^  as 
provided  by  the  various  Open  Universities^   has  been  focused  at 
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the  undergraduate  level.  By  emphasizing  the  postgraduate  level 
we  are  targeting  the  needs  of  college  alumni  who  are  seeking 
additional  training. 

Replacing  Interaction  ^Ith  Structare 

In  the  traditional  classroom^  patterns  of  interaction  exist 
between  teacher  and  students^  and  between  individual  students. 
Wlien  we  remove  the  instructor  and  other  class  members  from  the 
learning  process  and  incorporate  a  technological  bridge  (in  this 
case  audio  cassettes)  we  are  taking  away  the  interaction  and 
replacing  it  with  structure.  We  are  interested  in  exploring  the 
effects  on  learning  when  the  interaction  between  students  and 
instructor  is  not  present.  We  are  looking  for  answers  Lo  the 
following  questions: 

1.  How  is  this  type  of  learning  experience  going  to  compare  or 
compete  with  personal  classroom  instruction? 

2.  Will   the  adult  professional  be  motivated  by  a  prerecorded 
audiotape  of  graduate  level  course  work? 

3.  Will   the   lack  of  a  regularly  scheduled  class  meeting  time 
influence  the  students  ability  to  pace  themselves. 

4.  Will   the  educational  value  of  the  course  be  sufficient  to 
justif    offering  university  credit? 

What  Research  has  to  say  about  Rapport  and  Pacing 
Physical  proximity  of  instructor  to  learner  has  a  causal  effect 
on  the  learning  relationship  in  at  least  three  ways: 
1.      Verbal  and  non-verbal  clues  facilitate  the  interpretation  of 
information. 
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2.  Rapport  with  instructor  affects  the  intensity  with  which  the 
student  participates  in  the  learning  process. 

3.  Pacing,   through  regular  instructor  contact ,  directs  effort 
toward  regular  achievement • 

Audiotapes  transfer  only  the  audible  clues  through  modulation. 
The  experimental  model  and  testing  data  is  designed  to  indicate 
the  effectiveness  of  the  information  transfer.  In  this  model  the 
only  element  of  pacing  is  provided  in  the  deadlines  for  handing 
in  assignments,  and  contact  with  proctors. 

Significant  to  this  experiment  is  our  capture  of  the  actual 
classroom  experience  on  the  audiotape  rather  than  a  dramatization 
or  special  version  recorded  by  professional  readers.  We  think 
this  will  add  credibility  to  the  course  and  make  it  more  accep- 
table to  universities. 

There  is  some  indication  in  the  literature  of  rapport  being 
vicariously  attributed  to  the  tape.  A  survey  has  been  created  to 
obtain  data  on  what  rapport  exists  as  a  result  of  this  course, 
and  what  iipportance  the  expertise  of  the  ins'^iuctor  may  have. 

Survey  of  Experimental  Group 

In  the  survey  we  attempt  to  evaluate  specific  elements  of 
rapport,  pacing,  and  attitude  towards  the  course  as  shown  in  the 
following  questions: 

1.       Do  you  see   this  course  as  being  helpful   in  your  current 
employment  or  future  career?  Explain. 


2,  What  is  your  evaluation  of  the  expertise  of  the  instructor? 

3,  Would  regular  contact  with  the  instructor  have  motivated  you 
to  complete  assignments  sooner?  Explain 

4,  Did  the  taped  ^  ersion  of  the  course  offer  any  advantages 
over  your  past  experience  in  a  class  room  setting? 

5,  Would  a  more   structured  course  with  dates  given  for  the 
completion  o?  each  lesson  and  assignment  be  helpful? 

After  reviewing  the  available  research  in  the  area^  we  will  now 
move  on  to  our  research  design  and  preliminary  findings. 

This  research  was  undertaken  with  the  object  of  finding  a 
delivery  system  that  can  provide  high-quality  instruction  to  the 
twenty  three  million  college  graduates  currently  living  in  the 
United  States.  Many  of  these  people  wish  to  continue  their 
education  bat  are  hindered  by  rigid  university  standards  which 
require  residency  in  daytime  campus  programs.  For  those 
individuals  wno  are  working  during  the  day  there  are  f ewr  if 
any,  options  open  for  graduate-level  education.  If  a  delivery 
method  can  be  found  for  distance  learners  that  will  maintain  the 
quality  and  the  academic  content  of  the  day  school  campus  class ^ 
the  universities  may  be  influenced  to  allow  credit  for  these 
courses  and  thus  meet  a  great  need  of  their  alumni. 

To  guarantee  the  academic  quality  and  content  of  the  course  we 
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felt  that  it  was  necessaryr  so  far  as  was  possible^  for  the 
distance  learner  to  have  the  same  academic  experience  as  the 
on-campus  student  had.  We  theorized  that  if  this  could  be 
properly  doner  the  motivation  and  additional  experience  of  the 
off-campus  learners  might  compensate  for  any  disadvantages  in  the 
delivery  system.  After  some  deliberation  it  was  concluded  that 
an  audiotape  transcription  of  the  day  class  might  meet  this 
requirement.  The  tape  can  deliver  all  of  the  instruction  and 
student  input  that  takes  place.  Everything  that  the  day  student 
hears  in  the  class  will  be  conveyed  in  identical  language 
to  the  distance  learner. 

Our  next  step  was  to  allow  for  the  visual  information.  We 
planned  to  accomplish  this  by  having  a  class  member  carefully 
copy  all  of  the  static  visuals  used  in  the  class.  The  chalkboard 
and  overhead  projector  are  most  commonly  used  for  visual- 
instructional  support  at  the  university.  Copies  of  the  visuals 
used  will  be  included  with  the  class  hand  outs  in  a  student 
syllabus.  Headings  and  lesson  numbers  on  each  visual  will  match 
it  with  the  appropriate  lesson. 

Next  we  needed  to  select  a  course  to  tape.  A  survey  was  made  to 
ask  local  high-level  corporate  managers  which  graduate  courses 
from  the  School  of  Management's  catalog  they  felt  would  have  the 
greatest  value  for  management-level  personnel  in  their  organiza- 
tions. An  MBA  course  which  was  highly  ranked  in  the  survey  was 
selected.     Titled   "Management   Philosophy   and   Style"r  it  was 
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taught  by  a  thirty  yedr  veteran  professor  who  had  recently  been 
the  Deart  of  the  School  of  Management  at  BYU.  Permission  was 
obtained  to  audiotape  the  course  during  the  next  semester. 

We  talked  to  the  instructor  and  learned  the  course  content  and 
requirements.  Then  we  were  ready  to  develop  a  research  design. 
Professional  help  was  obtained  from  a  faculty  consultant  in  the 
Statistics  Department.  He  suggested  that  we  compare  the  test 
results  from  both  the  midterm  ^nd  the  final  exams  taken  by  the 
campus  students  with  the  same  exams  taken  by  the  otf-campus 
group.  Since  graduate  courses  usually  have  smaller  enrollments 
than  the  undergraduate  classes^  we  decided  to  use  a  T-test  for 
comparisons.  A  box  plot  is  also  planned  to  assist  us  in  further 
examining  the  data.  We  will  keep  copies  of  all  of  the  tests 
before  they  are  graded.  Then,  after  deleting  all  names  or 
identifying  information  from  each  test  we  will  assign  it  a 
number.  The  tests  will  all  be  corrected  at  the  same  time  by  one 
grader  who  has  been  trained  for  this  assignment  by  the  instruct- 
or. This  person  will  have  no  way  of  identifying  either  the 
student  who  wrote  the  test  or  the  group  to  which  that  student 
belongs  while  the  tests  are  being  graded.  The  identifying  numbers 
will  be  used  to  separate  the  two  groups  scores  tor  the  statist- 
ical comparison. 

Conducting  the  Experiment: 

With  the  design  in  place  we  now  proceeded  to  tape  the  course.  A 
good  quality  reel  to  reel  recorder  was  used.     We  used  a  two  track 
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recording  system  with  a  lavalier  mike  on  the  instructor  and  two 
additional  mikes  on  stands  in  the  room  to  pick  up  student  input. 
The  taping  went  well  except  for  the  background  noise  we  picked  up 
from  the  classroom  mikes  on  one  of  the  tracks.  We  had  an  average 
attendance  of  eighteen  students  in  the  course •  An  observer  in 
the  classroom  copied  all  of  the  visual  information  used  in  the 
class  for  the  student*  syllabus.  He  also  took  n^^es  on  student 
attendancer  the  number  of  students  who  asked  questions  or 
participated  in  class  and  other  items  of  this  naf  j  e.  The 
instructor  relied  on  the  chalkboard  exclusively  and  no  films, 
slides  or  transparencies  were  used. 

After  completing  the  taping  we  decided  to  make  two  versions  of 
the  course.  The  first  version  would  contain  the  entire  course 
with  all  of  the  lectures,  class  discussion  and  group  sessions. 
The  other  version  would  have  the  student  comments,  questions  and 
group  discussion  sessions  edited  out.  In  this  way  we  hope  to 
determine  whether  or  not  the  student  interaction  is  a  valuable 
part  of  the  course  for  the  distance  learner.  We  edited  out  as 
much  of  the  background  noise  as  we  could.  At  the  end  of  this 
procoss  we  had  two  versions  of  the  course  available  in  three 
different  formats;  the  reel  to  reel  format,  the  standard  cassette 
format,  and  a  special  slow  speed  format  selected  because  it  gave 
us  the  advantage  of  putting  the  whole  30  hour  course  on  three 
cassettes.     Now  we  needed  a  test  audience. 

We  explained  our  project  to  training  directors  and  two  corporat- 
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ions  agreed  to  furnish  us  some  management-level  volunteers^ 
r-indomly  selected  to  take  the  course.  We  ended  up  with  fifteen 
students  for  the  fiist  triul.  Each  one  was  asked  to  recommend  a 
proctor  to  give  then  the  exams  and  to  send  us  the  information 
TXf  jessary  to  make  the  test  arrangements.  Students  were  given  the 
same  information  and  course  requirements  that  the  <  ampus  class 
received.  Added  to  their  instructions  was  a  brief  explanation  on 
how  to  use  the  special  long  play  recorder  that  was  included  in 
the  course  package.  The  students  were  given  a  schedule  of  when 
the  testing  periods  would  be  and  when  assignments  were  due. 
Tests  will  be  mailed  out  to  a  proctor  at  the  company  who  will 
administer  the  tests  and  return  them  to  us. 

The  experimental  course  is  now  undecway  with  a  small  group  of 
students.  V7e  are  beginning  to  get  the  data  back.  We  have 
received  the  midterm  examinations  from  most  of  our  test  group. 
These  papers  are  being  graded  by  a  competent  grader  and  returned 
in  order  that  the  students  can  get  feedback  from  their  work. 
This  preliminary  information  is  helpful  in  making  qome  early 
predictions.  The  research  data  for  the  statistical  model  will 
come  from  a  second  grading  of  the  tests  done  later  by  a  different 
grader.  Because  of  the  small  sample  wo  are  dealing  with^  we 
recognize  that  the  results  that  we  obtain  are  not  conclusive.  We 
expoct  to  gather  data  from  many  more  students  ^o  give  validity  to 
the  study. 

Prfc^liminary  Findings 
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The  limited  information  that  we  currently  have  suggests  the 
following : 

1.  Distance  learners  in  this  study  will  generally  achieve  higher 
scores  on  the  examinations  than  the  graduate  students  who  took 
the  course  on  campus.  Their  field  experience  has  given  them  a 
depth  and  breadth  that  doesn't  show  up  in  the  university  stu- 
dent's tests, 

2.  Information  from  the  distance  learners  indicates  that  if  this 
coursi  could  be  offered  for  university  cred^ty  it  would  be  of 
interest  to  more  people  and  provide  a  greater  motivation  for  the 
participants  to  complete  it.  We  have  received  several  express- 
ions from  people  saying  that  this  method  of  distance  learning 
provides  exactly  what  tney  have  been  looking  for  to  further  their 
education  and  their  career.  This  suggests  a  market  for  courses 
of  this  type  particularly  if  universities  will  make  them  avail- 
able for  credit. 

3.  The  delivery  system  involveu  .ic^re  limits  Lhe  course  offerings 
to  classes  that  are  not  highly  interactive.  if  this  delivery 
system  were  to  be  used  in  a  degree  program^  a  combination  of  both 
campus  and  distance  ""earning  experiences  wou.ld  be  desireable. 
Further  studies  are  planned  to  determine  if  this  delivery  system^ 
coupled  with  videotapes^  can  successfully  convey  the  educational 
content  for  courses    requiring  laboratory  experiences, 
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4.  With  some  testing  and  modif icationr  this  model  has  the 
potential  to  meet  the  needs  of  many  adult  learners.  It  could 
create  a  significant  market  for  those  universities  and  colleges 
who  chose  to  incorporate  it  as  an  alternative  in  their  graduate 
course  offerings. 

5.  The  low  cost  of  production  and  distribution  of  this  delivery 
system  make  it  capable  of  a  high  degree  of  profitability  in  the 
event  it  adequately  meets  the  expectations  previously  described. 

While  there  are  many  ways  of  extending  professional  distance 
education  courses  to  adult  audiences^  this  one  has  the  potential 
of  receiving  university  approval  for  credit.  We  hope  that  it 
will  provide  a  much-needed  option  not  presently  open  to  most 
adult  learners. 

Note:  The  data  from  this  research  will  be  available  in  the  early 
spring  of  1986  and  the  outcomes  of  the  study  should  be  ready  soon 
afterwards.  For  a  copy  of  this  information  send  $2.50  to  cover 
postage  and  handling  to: 

Dr.  Robert  L.  Hales 
154  Harman  Building 
Brigham  Young  University 
Provo,  Utah  84602 

Phone  801-378-4903 
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tnstruct lunal   design  should  be  viewed   in  relation  to  the 
Dthc-T  ^reab  of   inquiry  within   education.    Beauchamp  (1968) 
states   that  education   is  comprised  of   l-nowledge  about 
ifistr  ucii  un ,    curriculum,   counseling,   administration,  and 
evaluation.    Snolbec^er    (1974)    compares  the  areas  of 
curriculum  and   instruction  by  stating  that  curriculum  is 
concerned  primarily  with   "what"   to  teach   while  instruction 
IS  concerned   with   "how"   to  teach.    Looi-ing  mcDre  specirically 
at  the  art^a  of   instruction,   Reigeluth    (1983)    views  it  as 
bc-'ing  comprised   of   five  major  activities:  design, 
development,    implementation,   management,   and  evaluation.  He 
further  slates  that  each  of   these  professional  activities 
has  an  associated  discipline  which   is  an  area  of  inquiry 
cnncerr-od   with   improving  the  performance  of   each  activity 
with  optimal  results. 

Cor  Jan    ( 1968)    def i nes   i nstruc 1 1 onal    theory  as   "a  se  t  of 
s tatei.^.ents  based  on  sound  replicable  research,   which  would 
permit   one   to  predict  how  particular  chianges   in  the 
cHiucat  1  oriai   environment   would  afiect  pupil    learning"    (p. 3). 
McA/er    (1981)    states  that  because  of   the  e^iplosion  of  useful 
l-MQwledge  concerning  human  cognitive  processes  and  memory 
E:-'    ucture  within  the  past    10  years,    instructional  theory 
should   be  based   on  cognitive  theory. 

The  quGjs:>t  for  the  development   of   broadly  acceptable 
1  rist ruct  1  onal    theory  has  led  to  a  growing   interest   in  the 
d^_slgn   scit_<ice  of   instruction    (Glaser,    1976;  Reigeluth, 
Bjjnderson  ,        Merrill,    1978).    The  goal   of   this  new  science  is 
+  u  dcve]  op  a  c^idre  of   those  prescriptive  principles  of 
instruction  which  may  be  applied   by  instructional  designers 
z\nd  evaluator  s.    Reigeluth  and  Merrill    (1979)    state  that  when 

0  sufficient   number  of   these  pri{iciples  l.ave  been 

1  dti'nt  1  f  1  b'd  ,   defir^ed,   and  validated   instructional  designers 
can   thefi  prescribe  methods  that  will   optimize  learning   for  a 
givt-Ti   set    of   conditions.    In  addition,      when  a  set  of  models 
wf   teaching  can  be  developed  from  these  principles,    they  can 
+  h»-'n  coniprise  a  basis   for   ctr»  ^-^cc  ep  t  ^-tb  1  e  prescriptive  theory 

instruction    (Reigeluth       Darwaireh,  1982). 

A  widoly  re:?searched  uspec+    of   designing   instruction  deals 
witli  structuring   and  sequencing   information.  Structure 
t  efers   to  thie  ge^^neral   or  gari  i at  i  on  of    instruct  lor^  while 
^>oquenciMg   "refers  to   the  design   (jecisions  pertaining   tc  the 
^'I'ier    in   which  subject  matter    is  preseiite^d    (ie«,  the 
1  i-l  ationnhip   of   concepts  and  priiicipie<»  within  a  knowledge? 
L^xnairO,   which  build  upr)ri  e)^lstlnq  cognitive  siructure-s  to 
produce  \  lOw  or  el  a bora ted  cogn 1 1 1  ve  struct  ur es"    (fill ema , 
I'^T)?,   p.  170).    A  major   researcher    who  hc:\r>  hc^lped  to  shape- 
'hi;>  arc^a  of    study   is  Robert  Gagne    (Merrill,    1977).    Hi '."> 
I  heur  y  ,    ^ '^luwn   c"i?>  the  luhiuI  alive   lec\fning   theory  (Gucjr«e 
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196Ga)  ,  1^3  based  on  Lhe  construction  of  learning  hierarchies 
■i  ar  purpose  o-f    systematically  organic:  ing   in-furniaiion  to 

be  learned  thro*»ah  an  analysis  o-f   the  final   tasi  or 
br-havi  c^ral   outco,       ji   the   i  nstruct  i  on  . 

More  specifically,    this  tas^    analysis  begins  with  the  final 
behavioral   tasl    froffi  which  all   subor'dinate  capabilities  c^r  e 
identified.    The  hierarchical   relationship  of  these 
capabilities   is  then  organiiied  by  evaluating  what  the 
individual   would  have  to  ^ now  how  to  do  in  order  to  exhibit 
this  new  capability  or   tas^    (Gagne,  i968b>. 

The  levels  of   these  capabilities  in  the  hierarchy  are  then 
related  tc3  the  ieve^ls  of   learning    (Gagne  and  Briggs,  1974), 
where  ecich  capability  corresponds  to  a  type  of  learning 
cl  assi  f  i  cati  or» ,    ie»   problem  solving,   principle  learning, 
concept  learning,   multiple  discrimination.    Each   level  or 
type  of   learning  is  also  designed  as  being  prerequisite  to 
the  one  above  and,   therefore,   must  be  learned  before  the 
student  can  go  up  the  structure  to  successfully  complete  the 
desi  red  task . 

This  analysis  of   prerequisite  learning   is  necess^^ry  when 
designing   sequences  of    instruction.    Although  the  learning 
hierarchy   itself  does  not   directly  present   the  desired  or 
needed   sequence  of    instruction,   according   to  Gagne  and 
Briggs    (1974),    it  represents  a  ^  i  nd  of    intuiti^'e   logic  whicfi 
provides  a  n.-^aningful   conteiit   for   a  design. 

CirJQ^^R  t  /Pr  iQ'^lQli^  k^^LQlQQ 

The  teaching  of   elaborate  concepts  and   principles  may  pose 
difficulties   for   the  application  of   learning  hi  er£<rchi  es. 
These  types  of    learrung   ofttrn   require  the  syrinhesis  of  a 
ifiulLitude  of   obscurely  related  concepts  or   ideas  whose 
r  p?l  £xt  1  or-ships  dcj  r^ot   fit   into  a  traditional    linear  sequence. 

Tenryson   and  Boutwell    (1974)    define  a  concept  as  a  class  of 
at)jC'Cts  or   ideas  which  are  characterised  by  the  same 
critical   a|-tr  ibulres.    If   the  definition   is  applied   to  a  task 
analyi^is  method  of   learning,   a  subject  would  have  to  e^jhiLit 
compet .*^ncy  in  thr^ee  major   tasl-    levels:    1)    remembering  an 
iristc^rice,    2)    reniembering  a  gerieral3ty,   £\rid   3)    applying  a 
generality   (Merrill,   Reigeluth       Faust,    1979?  Merrill 
ru-nriyson,    1977).   A  generality   is  defined   a<^">  an  abstract  ur 
general    statement   that  can  be  applae^d   to  a   variety  of 
<:4jecific  L>ituatians,   such   as  the  definatiuri  uf   a  corcepl  ur 
i  ht_^  statement   of   a  procedure.    An   3  nstance  is  defined  as  o 
specific   object,   everit  ,   or    symtjol   such  as  ar^  cs'ample  of  a 
concept  or  an  application  of   a  procedure. 

j^cugolulii  cirid  Merrill    (1979)    dvfjne  a  pririciple  as  ar^ 

at .1  on   wh-ich    "specifies  a  cause-and  effect  relationship 
Hfiiuny  i>evC'ral   event  concepts"    (p«14).    The  use  of  principles 
1      general  ly   f ound   i  n  the   teach i  \\q  of   1  ar  ge  amoun  Ls  of 
1  ri  f  ormoli  ori  or   fT"«acr  o  str  ategi  es  wha  chi  Rei  gel  uth    ( 1979 ) 
defi(U33  as  "ways  of   orgaji  i ::!  i  nq  those  .aspects  of  uistruction 
wl  1 1  ch  r  el  ate   I  o  niur  e  than  t)ne  top)  i  l  ,   sue  h  as  sequcMici  ng  the 
Ltip  1  cs  ,   shawx  r.q   i  n  ter  rel  at  i  onsh  i  ps  amur^g  the  top  l  cs  ,  and 
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previewing  or  reviewing  the  topics"    (p. 8). 

Two  j^odels  o-f   teaching  which  deal   specifically  with  the 
pr€?sentat  X  on  o-f   large  amounts  o-f   information  or 
mcicro-stf*^  ategi  es  are  the   "Advance  0»-gani2:er"    (Aur^ubel  ,  1960) 
,=^rid  the   "Concept  Elaboration  Model   of    Instruction"  (Merrill, 


^^yance  Qrgani^iier 

One  tnodel   of   teaching  advocated  for  use   in  task   analysis  is 
the   "Advance  Organizer"    (Gagne  ?/  Briggs,    1974).    This  model, 
based  on  the  theory  of   meaningful    learning,   has  been   a  topic 
of   research  for  the  past   15  years.    Joyce  and  Weil  (1980) 
state  that   the  pr  i  mar y  goal   of   the  advance  organ i zer   is  to 
<.onvey   large  amounts  of    information   in   as  meaningful  and 
t--fficient   a  manner  as  possible.    Therefore,    the  advance 
organizer   is  well   designed  to  teach  concepts  and  principles 
which  require  the  synthesis  and  assimilation  of  subconcepts 
and   facts   into  broader,   more  meaningful    thoughts.  Ausubel 
(1968)    df?fines  advance  org£<nizers  as   "-appropriately  relevant 
arid   inclusive   introductory  materials...    introduced  in 
^.'cl/ance  of   learning...    and  presented  at   a  higher   level  of 
cAbstrac  ti  or» ,   generality,   and   inclusi  veness"    <p.l48).  Ausubel 
'1977)    further   states  that   the  function   of   the  organizer  is 
"to  provide  specifically  relevant   anchoring  ideas  for  the 
iTtore  differentiated  and  detailed  material   that  is 
subsequently  presented"    (pp. 167-68).    This  organizer  may  then 
represent   a  design  for   the  optimal   sequencing   of  those 
competGrnci  es  necessary  to  successfully  teach  the  desired 
pTinciple,   concept,   or   fact.    Mayer    (1979)    pre<-iients  five 
itiajor  characteri^atics  of   the  advance  organizer: 

(1)    Short  set   of   verbal   ar^d  visual    information;  iJ^) 
Presented  prior   to  learnincg  a  larger  body  of 
t  o -be-1  a^ar  ned   information;    ("J.;    Containing  no  speci  +  ic 
content   from  the  to"-bv_- 1  earned   information;  (4) 
F'r  oviding  a  means  uf   generating   logical   r  el  at  i  unstii  p 
among   elements   in    the   to-be-learned   information;  (!5) 
Inf  luencing  the  lear  ner    s  eriuoding  pr  ucess-  (p. 

r: -^senti  al  1  y  ^^usubel    (1978)    has   ider^tifiec^   two  tvp<?s  u-f 
c-ulvarfce       gc^ni  :^er  s:    the  ei^pository  urgani*:c'r    (wnich   is  use^d 
Lrj  teach  completeJy  new  materia))    and   the  comparc^tive 
'-^i-  gaij]  zei"    (which   is  used  to  teach   familiar    or  relatabio 
L  .    in  both  model  s   the  bul  k  of   the  synthesi i  ng 

]  f  i1  oi  (hi-iLj  on  ] '=s  presenttjd  ^^t  the-  beginning  with  a  br  i 
f  fi  nf  orc€?ment  synthesis  or  summary  at  the  end  of  the- 
pr  esent  at  3  or)  of  information. 

(Jr\e  important  character- 1  st  i  c  o+   an  advance  orqani^rt^r  i 
that    ]  1   IS  [lot  designed  as  a  suuimar  y  ur    an   ovt^r  view. 
:-)Uininar  I  e's  or  overviews  are  presented  at   the  same   Jevt?l  i)f 
f-djstr  act  1  on  ,   gene-rality  and   i  nc  1  usi  veru.-'S^.  cis  1  hp  ]ecH.rriing 
iric-itfj^i  iai'^.   Lhemsolves.    "They  <3]mply  emphasize  the  'i^alient 
pojiiLs  of   the  fTiaterial   by  omittirty    lei>s   i  i7jpoh  L  caFi  L 
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irif  onnati  on ,   and   largely  achievt^  their    e-f-fect  by  repetition 
c-irul  S3  mp*^  if  1  cation"    (Ausubel  ,    1^68,  p.  148).   The  goal   o-f  the 
advance  organiser,   in  contrast,    is  to  prescribe  a  cognitive 
■framewfjri    within  which   all   subsequent   instruction  may 
logically  -fit. 

Q(jQ<lit?t2t  iiabgratign 

Another    distirctive  task  analysis  model   of   teaching  and 
theory  is  the   "Concept  Elaboration  Theory  of  Instruction" 
(Merrill,    1977).    Like  the  advance  organir:er,  concept 
elaboration  prescribes  a  framework  within  which  concepts, 
principles,   or   procedures  may  reveao.    logical   order.  However, 
unil^e  the  advance  organizer,   in  which  the  entire  organizing 
structure  is  presented  at  the  beginning  and  end  of  the 
instructional   process,   the  concept  elaboration  model 
intersperses  its  organizers  or   epitomes  throughout  the 
t?ntire  instructional   experience  by  moving   from  a 
gtrieral -t o-detai  1  ed  sequence  of    instruction.  Reigeluth 
(1979)    draws  an  analogy  wi th  the  process  of   zooming   in  and 
uut  of   a  camera  lens.    In  order   to  see  all   of   the  parts  of 
the  picture,   a  pt^rson  starts  with  a  wide  angle  view  of  what 
*s  to  be   learned.    Then  the  person  zooms   in  on  one  part, 
halting  the  zoom  at  different   levels,   to  study  the 
interrelationships  of  the  explored  part  with  the  other  parts 
of  the  picture.    After  part  of   the  picture  is  satisfactorily 
explored  ur   elaborated,   the  person  zooms  our  and  repeats  the 
process  with  another    part.   After  all   of   the  significant 
pc-trts  of   the  picture  have  been  ejjplored,   the  person  -:ooms 
bac^    out   to   the  wide-angle  position.    At  this  point,  the 
broadest    topic   o-^   the  instruction,   or   epitome,   will  bfc: 
:-,-^t  1  sf  cic  tori  1  y  understood  . 

Pe    gt/luthi  and   Darwazeh    (1982)    define  an  epitome  as  "cnn 
overview  of   the  relationship  ba^tween  prinriples,  concepts, 
c«lrjects,    events  or   ideas  which  are  presented  at  ari 
..application   level    including  generalities,   examplei-:>  and 
pi  cActice"    (p. 31).    The  definition   xs  dqain  ur^iquely 
'ii  .,(:  met  1  ve   from  the  advance  organizer   in  that   it  doe^  r»at 
e'liiphasizc-   "hugher    levels  of   abstraction,   generalaty,  arid 
inclusi  v^^ncss"    (Ausubel  ,    1968, p.  148).    Instead,    it  describes 
»_';MCtly  what  art  advance  organizer   does  not   do,    iv,  whiich 
"vMiiphasizes  the  salient  points  of   the  material...  and 
c«'"hifvej  their   ef-^ect  by  repetition  and  simplification" 
kAusubel  ,    1760, p.  148).    The  concept  elaboration  model 
lifticjuoly  presents  the  epitomes  or    organizers  Csl  cve-r  y  level 
Kii    elaborative   instruction   instead  of   only  at   the  fegir^nirtq 
c-uid  euid  of  the  presented   i  nf  or  mat  i  urj .    The  elaboration  style 
L'f   structure  and  sequence,   therefore,   naturally  incorporates 
iucrc'rtsjnqly  higher    levels  of   abst  r  act  i  or^ ,    gf?rier  al  1 1  y  ,  arid 
1 nu i usi veness  through  a  continual   synthesis  of  informAtiort 
1  I  \r  C'l  iqhc;u  t   t  he  ent  i  r  e  present  at  i  on  . 

f\n  e,cainpl(=*  can  be  found   in  creative  writinq.    (f   a  writer 
aljplJC'iv  in  qreater    detail    the  r  e]  at  i  or^sh  i  p  betwecTi  plot, 
^ht?mj?,   and  characterization,   his/her  creative  writing  style 
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iK.proves.    The  concept  elaboration  model   assists  the  student 
wi  Iter   by  presenting  the  cognitive  information  and 
I- flati  onships  o-f   this  in-formation  at  each  deeper   level  o-f 
the  learning  experience.   Since  this  is  an  application 
approach,   the  student  practices  what  he/she  has  learned  at 
each  levDl   of  elaboration.    The  result   increases  the  students 
field  of   ej;perience  and   lays  the  foundation  for  deeper 
1 nvesL 1  gat  i  on  and  understand i  ng - 

FrofP  those  ideas,   definitions,   concepts,   and  principles  the 
two  structure  and  sequence  models  may  be  compared. 

Eiiit^t^d  Research 

Three  major  reviews    (Barnes       Lawson ,    1975;    Mayer,  1978; 
Faw  ?/  Waller,    1979)   and   four  c    itiques  of   the  reviews 
(Lawton  ?y  Wansia,    1977;    Ausub      ,    1978;    Mayer,    1979;  Kozlow 
White,    1930)    have  been  writte     about  advance  organiser 
research  within  the  past  nine  years.   To  date  there  are  few 
reviews  o^  concept   elaboration  research. 

In  a  review  of   concept   elaboration  as  an  emerging 
instructicnal   theory,   Mayer    (1981)   sttv  _es  that   "in  some  ways 
the  epitome  is  like  the  advance  organizer,   because  it  is 
irttendec   to  provide  a  general   context   for   all   new  incoming 
information"    (p. 23).    He  further  states  that  the  analogical 
model   and  assimilative  context   for   learning  of   the  advance 
organmer   have  a  relationship  with  the  sequencing, 
s/nthesizing  and  summarii^ing  components  of   the  elaboration 
tfieory  arid  that  this  relationship  needs  to  be  explored  in 
mure  detai 1 . 

Mayer    (1981)    states,    'It  striies  me  that  the  definition  cf 
an  epitome  should  bo  consistent  with  what  we  know  about  the 
c  hiaracter  i  st  i  cs  of  advance  organi2:ers"    (p. 25).  Therefore 
r(^viows  on  advance  organizer  research  will   be  used  to  ma^e 
iriferences  about  research  related  to  concept  elaboration, 
fh^^  critiques    (Lawton       Wanska,    1977;   Ausubel  ,    1978;  Mayer, 
1^79;    I  Dzlow       Wriite,    1980)   of  the  reviews  of  earlier 
<.id/ar^~e  organizer  research  addressed  the  five  following 
u\<jjur    problems  as  cited   hy  Weil   ar^d  Murp.hy  (1982): 

1)  test  measure   incompatabi 1 i ty    ^Ausubel,    1978;  Mayer, 

J  777).    Most  studies  used  tec>ts  measuring  verbatim  recall  and 
ignored  meaningful   verbal   learning  and  long  term  retention; 

2)  failure  to  control   for      listing  subsumer S:,   in  cognitive 
:>l-ructuro    (Lawton  t  Wansla^    1977:    Ausubel,    1978;  Mayer, 
1779;    1-o-jlow  ?/  White,    1980).   Laci    of   control   for  e/.istinq 
'=.iib:-,umei' 3  renders  the  effectiveness  of   the  advance?  organizer 
inorJc'l    inipossible^  to  asccrt^an   bc-cau^je  *:>ub ject ^i:  mcty  t\c\VK' 
'=<lrpad  /  possessed  the  pr  t?re^qui  si  t e  inowledge; 

'•)    fajluro  to  asses.^-^  the  pr  e/sc'i  icc  of   t-jppt  upr  j  cit  e  bridyo 
"--•ignitive  structure    (Au<:.iibel  ,    1978;   Mayur  ,    1779;    loziow  -t/ 
WliMt.',    170O)  .    Sub]C'Li<i)  iuciy   Ic^cl    Ihe.^  idraiiona]        c^f  f  ol  di  rig 
iU'ue'-Dsary  to  utiJ  ize   the  advance  organizer  ; 

4)  f<ulure  U)  r->|-»aw  thc^t    loarrtct*..  u_,e'J   relcvarii  ^.r^ubsumcr  s 
M  ._\wi«-)n       Wanska,    1777;    Mayt^r  ,    1779);  and 

5)  fen  lurt^  to  uruilyzt-'  wht-the^u"    thic  ih<Ai  w  cunce-pt    in  L\\v 
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advance  urgarar'er   is  an   -appropriate  subsumer  for  the 
^  wi  cjir  a\nti  on   in  the  learriing  aiaterial    (l-oiilow  ?/  Whiite-*,  1980). 
Am  analysis  of   the  conceptual   c'jnteit   m  relation  to 
structure  and  sequence  o-f   the  in5truct\oii  to  be  learned  is 
necessary  be-fore  conclusions  can  be  drawn. 

ifi  additi(jn,   another  m^-vjor   problem  found   iw  this  advance 
organiizer  research   is  an   inequality  in  instructional 
ir  er-.t.merit   time  between  control    and  er>per  i  mental   groups  (Weil 
Murphy,    1983;    Wilcox,   M^--^       U,   Z<  Black,  1981). 

i^£L9C9t*Qd  9i  the  Study 

Altr.ougn  tas^    analysis  has  been  a  subject  of   research  for 
many  years,   there   is  little  consensus   (Carlisle,    1983)  about 
what   "tas^    analysis"  means  or  how  a  tash   analysis  should  be 
done.    Davies   (1973)    describes  task  analysis  in  terms  of  its 
=subtas^  s .    These  sub  tasks  ar  e  used  to  desi  gn   i  n  struct  i  on 
which  will   reduce  error   in  human  performance.    This  process 
(Patr3c^        Stammers,    1978;    Carlisle,    1982b,    1983;    Springer  Z< 
Powers,    1703)   primarily  requires  a: 

1.    breakdown  of   the  tas^,   content   etc.,    into  constituent 
el ement s ; 

iJn    deter  an  nati  cjn  of   the  relationships  among  the  elements; 


3.    restructure   in  accordance  with  •*~'ie  underlying  principle 
or   optimal    learning  design. 

The  medals  of   teaching  wiiich  apply  this  process  of  task 
cjicJysis  are  numerous  and  varied   in  their   design.  Two 
t usl -anal ysi s  based     models  dichotomous   m  their   design  are 
"Rdvance  Organi;zer"   and   "Concept  Elaboration,"   Both  of  these 
niudels  are  espoused  as  being  reliable  fur   teachir.g  large 
concepts  or  pr i nci pies.    The  advance  organ i zer  may  be 
dpscribed  as  presenting  synthiesis   instruction  at  thie 
beginnir^g  of   a  presentation,   logical   sequence  of  instruction 
throughout  the  body  of   the  preserit at i on ,   and  synthesis 
cHijJ/or   si.unmt.'tr  y   instruction  at  the  end  of   the  presentation. 
I  h:?     oi  ic  t^pt    e3  abor  at  i  on   model  ,    3  n   contrast  ,  prese^rits 
•s/n  Lhe*::>i  s ,    iogiCcAl   sequence,   and  summary  instruction 
I.  hi-  uuqhout   the  t-ntire  presentation  by  weaving   thern  together- 
'-■^1    oach  elaborated   levet   o-^  instruction. 

The  "Loricept  FJaboration  Model   of    I  rist  r  i  u.  1 1  on  "  hc-t«:>  beeri 
Uni-ed  closely  with  the   "Advance  Organi.:er"    (Mayer,  1981). 
TIjcjs-  two  foodL^ls  inay  be  defined  as  parallel    ir   tfiei^  gn 
'-^ut  divergent   m  their   app   i  cat  i  on .    One  maJ(?^-  distinction  i 
1  hat   thfj  advance  or  gar^iner   prc^sents   its  synti,(^c,i  -  ^  r,q  ^^^^1 
snmmari/.ing   information  at   the  beginning   ar.u  end  of  the 
M"ii>t  r  uct  3  oru    The  concept   elaboration  model,   on   the  other 
Iiand,   omphasi;;:es  its  syn  thesi  ^  i  ni^   and  summarijin'"' 
1  ri  f  oi- mcd  3  orj  throughout    the  entire   instruction,    dr-. wing 
MiLeri' eLation<Dh3  ps  among  all    of   nhe  concepts,  ideas, 
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objects,   and  events  at  each   level   o-f   the  elaboration. 

One  goal   o-f   instructional   design  research    (Reigeluth  ?/ 
Merrill,    1979)    is  to  develop  a  cadre  o-f  prescriptive 
principles  which  will   organize  i  n-f  ormat  i  on  -for  instructional 
purposes.   Tasi-   analysis  is  one  method  of  analyzing 
3n-formation  -for   instructional   purposes-    This  analysis  o-f 
information  is  applied  primarily  through  the  development  o-f 
a   learning  hierarchy.    It   is  the  purpose  o-f   the  learningg 
hierarchy  to  graphically  represent  all   o-f   the  speci-fic 
levels  of   learning  related  to  the  instructional  content. 
This  hierarchy,   containing  the  detailed   information  to 
t--\ught  ,   will   then  provide  a  conte;(t  for   the  design  of 
instruction.   Two  models  of   teaching  which  use  this  task 
£«nalysis  approach  are   "Advance  Organizer"   and  "Concept 
El ^bor at i on . " 

The  advance  organizer  model   as  described  by  Ausubel  (1968) 
IS  designed  to  teach  information  through  provision  of 
" 1 deati  onal    scaf  f o] ding  for  the  stabl e   i  ncorporati  on  and 
retention  of   the  more  detailed  and  differentiated  material 
that  follows"    (p. 148).    According  to  Reigeluth  (1979), 
concept  elaboration   is  primarily  designed  to  teach 
3  I  if  or  inat  i  on  through  macro-strategies  which   are   "ways  of 
•jrcjanizinq  those  aspects  of   instruction   which  relate  to  more 
th£^n  owB  topic,   such  as  sequencing  the  topics,  showing 
interrelationships  among  the  topics,   and  previewing  or 
reviewing  the  topics"    (p. 8).    However,   there  is   little  or  no 
research  related   to  the  efectiveness  of    the  concept 
elaboration  model   o-i    teaching.   There   is  also  little  rese^arch 
(Wilco^c,   Merrill   ?/  Blaci,    1981)    which  explores  these 
sequencirig,   ^=>ynt  hesi  z  i  ng  ,    and  summarizing  approaches  to 
^p3chl^^g  concepts  and  principles. 

Fronrj  a  historical   perspective  this  genera  1 -to-detai  1  ed 
appr-o£*ch   to  designing   instrtiction  has  substantial  support. 
The  spiral    curriculum,   as  described  by  Bruner  (1960), 
e^iplams  how  ^^nyone  can  be  taught   something  about   any  topic 
'-if   *=.luriy,    as  Jong  as  the   i  nf  or  iTi£\t  i  cn   is  presented   at  the 
learncn-'s  appropriate  recontion   level.    Additional  research 
on  s-,chcnja  theory    (Anderson,   Spiro  •!/  Montague,    1977;  Collins 

UuiUian,    17  70;   Lind-i.j ,       Norman,    1977;  Rumelhart 
Di  toiiy,    1977)    based   on   Ausubel  's  fTiearnngful    learnirjg  theory 

Norman's   (1773)    web  of   learn]  r^g  b<=^^ed  on  E<runer  s 
approc-ich   to  the  spiral   curriculun   have  further  ^idvariced 
r  e'-.->ear eh   in  this  ar  ea . 

With   the  recent   introduction  of  coricept   elaboration  intj 
the  literature,   Na/er    (193n    stat(?s  that  there   is  a  need  for 
ernpi  r  i  CcU   supper  t  te  f  ur  thier   anal  yze  and  devel  up  +  he   thtjf^ry  „ 
Ma/er    furtht^r  notes   that  the  relationship  between  the 

t  r  ul.  t'lre-  and  se^qut^nce  c  har  ac  t  er  ]  st  i  r-<::,  of   the  <\dvcaiLe- 
ijt  (.j.Ziiii  re»-  and  co'"jL.-pt  el  abor  a  I"  i  (dr  model^"^  need^.?   to  be 
t'/pltJi-  €_'d    in   mt^r      denial  1  , 

Lliif  Cif    Ific   purposes  of    i  ri<^->t  r  iiu  L  3  orial    de-^iqii   r  ese  u  ^  h   3  ^>  to 
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validate  the  use  of    instructional   principles.   According  to 
Reigeluth    (1983)    ar d  Mayer    (1981),   the  instructional 
principles  o-f   sequencing,   synthesizing,    and  sufnmarizing  as 
they  relate  to  teaching  concepts  and  principles  via  the 
advance  organizer   and  concept  elaboration  models  o-f  teachiiig 
are  in  need  o-f   ex  pi  oration - 

There-fore,    the  purpose  o-f   thi*^  study  is  to  compc^re  the 
advance  organizer    and  concept   elaboration  models  o-f  teaching 
•4ith  a  tasi-.    analysis  approach.    This  will   be  accomplished  by 
ascertaining   i -f   persons  given  synthesis  and  summary 
instruction  at   every  sequential    level   of   an  instructional 
prograni  will   achieve  d i -f -f er en 1 1  y  from  persons  given 
=:>ynthesis  instruction  only  at  the  beginning  and 
synthesi  s/summai-  y   instruction  at   the  end  o-*    an  instructional 
program.    These  two  approaches  will   also  be  compared  with 
per  sons  given   a  logical   sequence  o-f   i  nst  ruct  i  on   ausent  ut 
any  syrithesis  or  summary-    To  maintain  tne  integrity  of  each 
approach,   all    instruction  will   relate  to   Lhe  same  concepts 
ai  tU  pr  1  nc i  p  1  es . 

^^^HiyiLi  Qi  the  btud>: 

Lee c\U::St:?  of   the   liiitiiej  I- esearch   in  this  area  a  need  exists 
to  perform  an   investigation  to  identi-fy   i-f   di-f-ferent  levels 
ot    ac|-ii  evement  exist  oetween  subjects   instructed  through 
/aried  approaches  o-f   sequencing,   synthesizing  and 
summar  1  z  1  ng   in-f ormation.    One  method  o-f   investigating  these 
potential   d  i -f -f  erences  is  to  develop  three  instructional 
progr£\ms  -for  the  same  topic  of  study.    The  first  program  is 
to  be  !ja<3ed  on   a  general   tast^   analysis  approach.    This  will 
t)f^^  used  cAS  a  basis  for   the  development  of   advance  organizc^r 
and  concept   elaboration  programs. 

I  f   those)  three   i  nstruc  1 1  onai    pr  ogr  ams  of   tas^  arialysis, 
advance  organizer   and  concept  elaboration  are  administered 
to  raridofKii  z  e.^d  subject£>,   then   the   levels  of   e-ichi  e  venient 
foeasured  b/  a  common  evaluation   instrument  will  determine 
thf>  ef  f  ec  1 1  ve^nfi'Ss  of   e^ich  model   of  instruction. 

Although   the  study  will   corupc^re  the  advarjce  orgartizer  arid 
ct'Mtcept  elaboration  models  of    teaching,    it  will  compare 
p'  1  mar  3  1  y  the  effects  of   the  three  characteristics  of 
'i^v^quence,   synthesis,   and  summary  common   to  both  models. 
nLthough   these  i\r  c  major  characteristics  of   thfc'  jiiodels,  tht=' 
re^oul  ts  will    in  no  way  reflect  the  greater  value  of  one 
model    over    the  other  for    all   coridi  tioiis.    IrtsteaJ,  the 
rsiqni  f  icance  of    these  results  will    relate  only  to  the 
•i  caching  of   concepts  and  principles. 

It   need   also  be  rioted  that  the  Advance  Organizet-  and 
Concept  Elaboratior^  Theory  of    Instruction  are^  primarily 
designed  to   incorporate  macrostrat  eg  i  es  or    numerou<o  head  iin(j 
•.>f'S3Jons   m  their   design.    A  distinction   r^t'onr,   to  b^- 
^?stahlished  where  a  mi  ci"ost  r  a  teq  y  begins  and  a  jnacrosti-  <^tegv 
t.'iids,    Flxamples  of   the  niodel  s  by   FCf -i  ge.^!  Lit  h    n77<^')    c-ind  Joyce 
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e-ind  Weil    (1980)    present  them  to  be  opei^  to  interpretation. 
For  instance,    the  teaching  o-f   the  principle  o-f   supply  and 
demand  may  be  the  -foundation  -for  a  ->eries  o-f   sessions  in  a 
CQurso  or   a  single  session   in  a  coarse.    The  importance 
relates  to  the  depth  o-f   learning   that   is  necessary  and  the 
ability  o-f   the  audience  to  quietly  understand  the 
information  being  presented.   This  study  will   deal   with  the 
presentation  o-f   mi  cr  ostr  ag  i  es  or   a  single  presentation  o-f 
in-formatinn  as  described  by  Joyce  and  Weil    (1980).  The 
pragmatic  itiliration  o-f   these  models  o-f   teaching  is 
necessary   i-f   the  instruct  ional    theories  are  to  have 
bi-  oad-based  application  to  teachers  and  instructional 
designers . 

Thu  St  udy 

1 1  was  hypothesi zed  that   the  concept   el aborat i on  group 
would  achieve  si  gn  i -f  i  can  1 1  y  higher   thai    (a)    the  advance 
oi  qanizer  group  and    (b)    the  task  analysis  group  on  concept 
learning   and  principle  learning  when   evaluated  upon 
ccjmpletion  o-f    instruction.    It  was  -further  hypothe<^^i  zed  that 
the  advance  organiner  group  would  achieve  significantly 
higher   than  the  tast    analysis  group  on  concept  and  principle 
leariiing  upon   completion  o-f    instruction.    It  was  also 
expected  that   similar   results  would  occur  when  assessed  with 
'^r^  equivalent   evaluation   -form  5  weeks  a-fter  instruction. 

The  sample  was  comprised  o-f   92  undergraduate  teacher 
e  ducation   students  who  were  eijposed  to  one  o-f  three 
i }  i<:->ti-  act  lonal    treatments  related  to  tasl    analysis,  advance 
ui-qanizer,    and  concept  elaboration.    The  three  treatments 
wc>re  validated  and  pilot   tested.    All   o-f   the  hypotheses  were 
*::iupported  -from  the  results  c-f   the  pilot  sLudy. 

T\iis   investigation  required  subjects  to  tahe  two  posttests. 
One  was  tal- en   upon   the  coiopletion   of    instruction;    the  second 
ur^re  tal  er^  -five  weol  s  a-fter   instruction.    Each  posttest 
L.nnsi^^ted  of   -fifteen  questions  related  to  concept  learning 
^\\\d  -fi-ftL'ert  que<_:itiDns  related  to  principle  learnir^g.  To 
in':r,uf  e  accuracy  of   the   instruments,   a  f  uder-Richardson 
U  Fc- :.'0)    produced  evidence  o-f  a  reliability  o-f    .840  and  .804 
in  l'u'z>tLest   t    (fl)    and  Posttest   2    <T2)  respectively. 

CA  ]    posttest   results  were  then   reported   as:    A.    the  sum 
^ot<^l    o-f   roncept   learning   in  the   first  postest    (CON-Tl);  B. 
tluj  <:>um  total   o-f   principle   learning   in  thte  -first  posttest 
(I-'RIN~T1 )  ;    C.    the  sum   total   o-f   concept   learning   in  the 
ofjcond  or    delayed  posttesi    (CON-Tr    ;    D.    the  sum  total  o-f 
principle   learning   in   the?  second  or  delayed  posttest 
(PRIN-T2);    and  C.    the  sum  total    o-f   both  coricopt  and 
prinuiple  1  earning    (CON/PR IN  -  Tl  /  IT')  . 

[n  addition  posttest    1    (Tl)    ar^d  po^>t  tes-^t    2    (T2)    SLore^u  wen- 
i  rjmpared  -for    achievement   according   to  thi?  categories  ot  A. 
•  i>r^-:r'pt   loc^rriing  and  D.   prirtciple  leaM.ing. 

Iht?   fir^^il    ^^itudy  was  perfot-med  on  a  'summer  schoo]  popula(-ion 
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which  required  additional   control   of  potentially  confounding 
variables.    To  control   -for   the  prei  dent  i -f  i  ed  independent 
variables,   a  series  o-f   One  Way  Analyses  o-f   Variance  (ANOVAs) 
was  per-f  ormed  using  the  variables  o-f   A)    levels  of 
acliievement ,   E^)    levels  of   experience,   C)    gender,   and  D)  age. 
The  one  variable  o-f   age  was  -found  to  have  a  signi-ficant 
effect.    This  variable  was  then  Covaried  using  Analysis  o-f 
Covariance    (ANCOVA)    -for   the  remaining  results. 

A  one-way  analysis  o-f   variance  was  per-f  ormed  on   the  -four 
ir^dependent  variables  o-f   achievement    (GFA)  ,   levels  o-f 
experience,   gender  and  age.    The  only  significant  finding 
occurred  with   the?  variable  o-f   age.   An  analysis  o-f   a  post  hoc 
student  Newman-f  eul  s  reported  a  signi-ficant  di-f-ference  in 
age  between  the  task  analysis  control   group  and  the  concept 
el aborat  3  on  group . 

A-fter   the  e-ffect  o-f  o-f   age  was  covaried,    the  remaining 
results  found  the  task  analysis  group  to  achieve 
ui  gni -f  icantl  y  higher    (.05  level)    than  the  advance  organizer 
ar^d  concept  elaboration  groups   in    (a)   concept   learning  upon 
completion  o-f    instruction  and    (b)    principle  learning  5  weeks 
after   instruction.    The  task  analysis  group  also  achieved 
S3 gni f icantly  higher    (.05  level)    than  the  advance  organizer 
group   m  principle  learning  upon  completion  o-f  instruction. 

\he  results  o-f  concept  learning  5  weeks  a-fter  instruction 
found  no  signi-ficant  di-fference  in  achievement  between  any 
of    the  groups- 

There-fore,    the  task  analysis  group,   containing  only  a 
r  t^coinmended  sequence  o-f   instruction,   achieved  si  gn  i -f  i  cant  1  y 
higher    than  the  advance  organizer  and  concept  elaboration 
groups,   containing  variations  o-f   sequencing,  synthesizing, 
ar>d  summarizirig  o-f    instruction,    in  -five  of   eight  evaluation 
3  nstruinents-    All   o-f   these   findings  were  in  direct  contrast 
to  those  anticipated,   base^d  on  earlier   pilot  results. 

POU.^I  yfilQns 
From  thte  -findirigs,    it   is  concluded  that: 

1.    Given   the  sample  ar^d  instructional   programs,    the  tasf 
anal/Sis  approach  appears  to  be  a  aiore  ef-fective  method  o-f 
instruction   than   concept  elaboration  or   advance  organizer  in 
le.>aLhiing   concepts  ar^d  principles. 

Gi  V6?n   the  sample  and   instructional   programs,  neither 
c^dvancc  organizer  nor  coricept  elaboration  appear   to  be 
'superior  to   tk  3  other  as  an   instructional  strategy. 

As  an  unant  i  c  i  pated  outcome  o-f   the  st  udy ,   age   i  s 
apparen 1 1 y  a  more  i mpor tant   factor   i n  determi n i ng 
ci[)|:'r  opr  i  ate   i  nst rue  clonal    str  at  pqi  es  than  pr  ovi  ous3  y 
"•••ijpec  ted « 

Thp   findings  o-f   thi  s  i  revest  i  qat  i  au   saippor  t  Wiv  sup  en-  i  or  i  Ly 
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o-f  a  task  analysis  approach  to  teaching  over  the  advance 
organiser  and  concept  elaborations  modals.    These  -findings  are 
in  con-flict  with  the  pilot  study  re£>ults  and  the  proposed 
hypothes*=>s  -for  this  study. 

Based  on  the  literature,   ci  need  exists  to  examine  the 
conclusions  in  greater   de-H-il.    First,   a  nesd  exists  to 
examine  through  the  liter   '    re  why  task  analytris  may  be  a 
superior  approach  to  teaching  concepts  and  principles. 
Second,   a  need  exists  to  explorp  what  research  or 
theoret ical   assumpt ions  rel ated   to  advance  organ i zer  or 
concept  elaboratioin  are  either  ^^an-f i •^med  or  questioned. 
Third,   a  need  exists  to  describe  the  e-f-fert  o-f   age  on  the 
study  and  compare  that  e-f-fect  with  other  research. 

SyetCiorit^  of  lask  Analyses 

Since  the  task  analysis  group  emerged  superior   to  the 
advance  org^^nizer  and  concept  elaboration  groups,   it  may  be 
concluded  that   it   is  a  superior  design  o-f   instruction  -for 
the  samp  1  es  and  treat  men  ts   in   this  study  •    In  the  -final 
r  esul ts ,   the  task  anal ysi  s  group  emerged  super lor   i  n  the 
posttest   1   related  to  both  cc  icept  and  principle  learning. 
In  posttest  2  there  was  no  si  v^n  i -f  i  cant  di-f-ference  between 
groups  in  concept   learningii   but   in  principle  learning  the 
+^asi'   analysis  grc';p  again  achieved  significantly  higher 
scores  than  both  groups.    I-f   one  considers  the  process  o-f 
prerequisiste  learning   in   task  analyr-Js    (Gagne  Z<  Briggs, 
1974),   the  subjects  in   th^*<=*  study  would  have  needed  to 
possess  an  appropriate  unatrstandi  ng  o-f  concept  learning 
be-fore  they  could  go  up  the  learning  hierarchy  to  principle 
le}arning.    There-fore,   one  would  have  expected  the  task 
analysis  group  to  be  superior   in  concept   learning  as  well  as 
principle  learning  on  the  delayed  posttest. 

However,   the  tas^   analysis  group  did  per-form  si  gn  i -f  i  cant  1  y 
better  than  the  advance  organizer   grcup   in   three  out  o-f  -four 
tests.    An  analysis  o-f   the   instructional   programs  shows  that 
the  entire  content  o-f   the  task  analysis  program   is  contained 
in   the  advance  organizer   slide/   tape  program.    The  advance 
organizer  contained  an   additional   number  of  meaning-ful 
synthesis  statements  at  the  beginning  and  a  number  o-f 
summary  statements  at  the  end  o-f   the  program.    The  results 
1  ndi  cate  that  subjects  exposed   l,^  the  most  cone  i  se 
instructional   program  achi^:?ved  the  highest.    It  may  there-fore 
be  suggested  that  the  concepts  and  principle  in  the 
I  r^str uctional   treatment  are  not   as  complicated  as  previously 
antic3patedr    Instead  the  concepts  and  nr-inciple  may  be 
concrete  enough  to  allow  easy  under stc  iding  through  use  u-f  a 
brie-f   simple  program  instead  of   the  longer  programs  o-f 
advance  organizer  and  concept  elaboration. 

Although  these   findings  support  a  superiority  of  tasi 
ancilysis,    it  need  also  be  recogruzied  ihiai   all   o-f  ihese- 
results  are  ir^  contradiction  with   the  pilot  study  resulti^, 
the  advance  organi-'er    literature    (Ausubel  ,    1^74),  the 
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concept  elaboration   literature   (Reigeluth,    1983)  and 
learning  hierarchy  literature  in   task  analysis  (Gagne 
Briggs,  1974). 

Ady§Q£§  QC9§Q12§C  ^Qd  Cgnceet  E^^aboratign 

Two  models  which   incorporate  task  analysis  are  advance 
organi  (Gagne  S<  Briggs,    19:4)    and  concept  elaboration 

(Reigeiuth 1983)  .   Since  both  o-f   these  models  in   the  study 
took,  the  sequence  characteristic  o-f   task   analysis  and  added 
on  the  £  ements  o-f   synthesis  and  summary,   these  programs 
were  both   longer  and  more  compr ehensi  ve  than   the  task 
analysis  program.    I-f  one  accepts  the  suggestion  that  the 
concepts  and  principle  are  not  as  complicated  as  previously 
ant  ici  pated  ,   then   the  longer  programs  o-f   advance  organi  2 er 
and  concept  elaboration   may  have  produced  boredom  and 
•fatlgu^^  in   the  subjects;   or  at   least  did  not  contribute  any 
addi  ti  onal   -factors.    Thi  s  probl  em  o-f   unequal    i  n  struct  ion  a  1 
treatment   time  between  control   and  experimental   groups  has 
been  acknoKl edged   in   the  1 i  teraturr  on  advance  organi  zer 
(Weil   ^<  Murphy,    1983;   Wilcox,   Merrill   S<  Black,  1981). 
Howevever ,   this   literature  would  generally  correlate  more 
instruction  time  with  increased  achievement.    There-fore,  this 
assumption  correlating   instructional    treatment   ti  me  with 
achievement   is  di-f-ficult  to  accept. 

Both  o-f   the  advance  organiser  and  concept  elaboration  are 
recommended  -for   use  with   large  amounts  of   instruction  or 
macrostrategi  es.    These  approaches  usual  1 y  requi re 
instruction   to  be  per-formed   in  more  than  one  session. 
Reigeluth   and  Darwazeh    (1982)have  indicated  an   e-fforL  to 
subsume  the  ability  to  teach  microstrategies   into  the 
elaboration  theory.    But  can  a  macrostrat egy  ever  ue 
perceived   as  a  mi crostrategy ;    and   i-f   so,   when?  Reigeluth 
(1979)    presents  an   example  o-f   a  macrostrategy   in   the  area  o-f 
economics-   He  states  that  the  princip"'^  o-f  macroeconomics 
require  an  elaborated  understanding  of  supply  and  demand  and 
df-?bits  and  credits.    This  may  in   fact  be  an  appropriate 
mcricrostrategy  for   a  high  school   students    but  how  difficult 
IS  this  principle  and  concept  to  for  adL'lt  who  has  never  had 
formal    instruction   in  economics?  For  the  adult,   who  is  more 
ll^ely  to  be  worUng  at  a   formal   operations  level    than  a 
high  school   student,   thiis  instruction  may  \jimply  be  a 
logical   process  wiiich   is  easy  to  understand.    Therefore,  thi<r> 
may  be  perceived  a<b  a  mi  cr  ostr  ategy  by  an  adult  who  can 
quicKy  comprehend   this   information.    Results  of   this  study 
the-n  pose  further   questions  rather   thc^n  clarify  reasons  for 
apparently  conflicting  findings. 


Whor^  age  wai>  coaipared  betweon  the  <r>ubjects  in   I  he.-  priaiary 
sLudy  and   those   in   the  pilot  study,   the  means  of   27. 35  y€3ars 
and  22.17   ye>ar  s  e^itist  re«:>pec  1 1  vei  y  ^  or   c^ach  population.  This 
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imbalance  in  age  is  a  further  concern  because  it  indicates 
tliat  two  substantially  different  age  groups  were  represented 
in  the  pilot  and  primary  study.   Therefore,   the  factor  of  age 
may  have  contributed  to  the  failure  to  reject  the  null 
hypotheses. 

Because  students  in  different  courses  comprised   the  sample 
of   the  primary  study  a  unique  population  distribuLion 
emerged.   The  mean   age  for  the  task  analysis  group  was  24.87 
years  old,   the  advance  organizer  group  was  26.68  years  old, 
and  the  concept  elaboration  group  was  30.42  years  old.  There 
was  a  significant  difference  in  age  between  the  task 
analysis  and  concept  elaboration  groups  at   the   .01  level. 
Even  though  an  analysis  of  covariance  was  used  to 
statistically  neutralised  the  effect  of  age  on  the 
achievement  results  one  wonders  if  age  could  have  had  an 
effect . 

Piaget    (1971)    in  his  analysis  of   cognitive  development 
describes  the  final   or  formal   stage  of   development  as 
occurring  arour d   12-15  years  of  aye.    This  level   of  cognitive 
development  is  characterized  by  the  ability  to  reason 
hypotheti cal 1 y .    It   is  the  opinion  of   many  educators  of 
adults    (Long,   McCrary       Ackerman,    1979)    that  cognitive 
development  continues  into  and  across  adulthood.   Research  in 
th^s  area    (El  kind,    1962;   Watson,    1968;   Papal ia,    1972;  Renner 
t  Stafford,   1972)    report  the  existance         college  and 
graduate  age  individuals  who  are  not  yet  functioning  at  a 
formal   operations  stage.    McKinnon   and  Renner    (1971)  reported 
un3  y  25"/.  of   a  col  lege  freshman  sample  to  be  at  the  formal 
stage.    Arlin    (3  975)   reported  that   31  out  of   60  female 
college  senio»      studied  were  classified  as  formal  thinkers. 
Chiapetta    (1975)    found  only  47"/.  of   15  K>8  female  teachers  to 
be  formal   thinkers.    The  results  of   these  studies  suggest 
that  age  effects  the  development  of   learning  styles  and 
individual   compettrnce.    Therefore  the  older  the  learner,  the 
greater  his/her  chance  of   working  at  a  formal  operations 
ii3V     and  achieving  higher  on  a  test  requiring   little  xio  no 

..^esis  or  summary  information.    Wxt^lln   the  conteiit  of  this 
stuG       the  older  the  subject  the  higher  he/she  achieved 
u^'.-mg  an   instructional   approach  which  perceived  the 
information  as  a  mi crostrat egy . 

Tfie  results  of   the  pilot   study  gave  valid  support  for  the 
primary  study  to  procede,   but  when  the  treatments  were 
£\cjmi  Hi  ster  fc^d  to  different  age  levels  a  new  patterr^s  of 
r-G-sponses  occured.   The  older  subjects  showed  greater 
acfiievement  with  the  simplest  and  fastest  approach,   the  tas^ 
analysis  approach;   the  middle  mean  age  group  showed  greater 
ac  hi  eve^merit  u->ing  the  more  in-dupth  program,   the  advance 
ur gamier;   and  the  younger  mean  age  group  showed  greater 
auhievement  usiriy  the  C3ther  moru  in-depth  approach  of 
C(jn(-.ept  elaboration.    It   then  appears  that  the  older  subjects 
I- L'spontJed  bettcn"   to  simple^  well   sequenced   instructior^;  the 
!TU(jdie  aye  subjects  responded  better  to  a  well  sequenced 
3  ri'^tr  uct  3  on  witli  i\  synthesis  at  trie  bey  i  ruling  ar^g  a  summary 
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at  thB  end;   and  the  younger  subjects  responded  better  to  a 
Wfc^ll   sequenced   instruction  with  synthesizers  and  summarizers 
interspersed  throughout  the  entire  prersentat ion  o-f 
1  n-f  orrpat  i  on  > 

Ari  ejjamination  o-f   the  di-f-ference  in  ages  between  the  pilot 
study    <22. 17  yrs. )    and  the  primary  study    (27.35  yrs. )  also 
suggest  that  the  primary  study  subjects  were  composed  o-f  a 
combi nat i  on  tradi  t i  3nal /nontradi  1 1 onal   col  lege  audi ence. 
Many  o-f   the  subjects  who  work   in  business  or  industry 
-full-time  and  enroll    in  classes  part-time  may  be  more 
accustomed  to  dealing  with  she.   t  concise  pieces  o-f 
in-formation  -from  which  to  draw  conclusions  than  traditional 
college  e^e  subjects.    A  traditional   age  subject,   on  the 
other  hand,   may  be  used  to  the  more  traditional  teaching 
approaches,   f-nowles   (1978)    states  that   the  traditional 
learners  are  conditioned  to  have  a  subject-oriented 
curri  cul um  whi 1 e  adul t  1  earners  tend  to  have  a 
problem-centered  orientation  to  learning.    This  is  due  to  the 
adult's  need  to  apDly  immediately  what  he  learns,   while  the 
traditional    learner  continually  postpones  his  application  as 
he^  graduates  -from  one  program  into  another.   This  may  explain 
in  part  why  concept  and  principle  learning  were  higher  in 
the  task  analysis  group   -for  posttest   1   as  well   as  why 
principle   learning  was  higher   in   the  task  analysis  group  -for 
postte^t  2. 

llI}t>lL£§ti  gns  for  Further  B§§earch 

Trom  the  conclusions  o-f   the  study,   a  suggestion   for  -further 
research   is  to  replicate  the  design  o-f   this  stuay  using 
iristructioinal    topics  o-f   varying  di -f -f  i  cul  t  y .    This  will  help 
to  correlate  instructional    strategies  with  easy-to-di -f -f  i  cul  t 
concepts  and  principles.    The  outcome  o-f   this  e-f-fort  will  aid 
in  evaluating  the  e-f-fective  parameters  o-f   task  analysis, 
^•dvance  organizer  and  concept   elaboration   as  instructional 
approaches  to  teaching.    A  second  suggestion  -for  -further 
research   is  to  replicate  this  study  using  the  same 
traditional   subject  population  as  used   in  the  pilot  study 
and  randomization  techniques  as  described  by  Campbell  and 
SI- an]  ey    (1963)  . 

The  unant  3  cipated  results  o-f   this  study  have  suggested 
consideration  of  correlating  age  with  instructional 
i>t  rateyies. 

The  nomenc  1  atur  ^^  of   the  nontr  ad  1 1 1  ona  1    learner  emerged  in 
1770s.    The     Enc^c  i  ggied  i^a  of   Educational^  !?esearch  (1969) 
d(^3cr3bed  the  standard  A<r<erican  college  student   as  being 
between   3  7  and  23  years  of   age,    living  on  or  near  campus, 
attending  cla<=:-^es  at   fii^ed   times  and  determined  places,  and 
•following  a  set  carraculum  o-f   sequenced  courses.  Althiough 
this  may  still   characterise  the  regular  academic  year 
<.>tudnnt,   the-  older   nont  r  adi  ti  onal   student  has  eaierged  on 

ompus  with  a  new  set  o-f   needs  and  demands.  Unfortunately 
niH'h  of   the  r  e?search   in  this  area  has  related  to  pr3or 
i^j^poi^  imental    Leru'-ning    (CommissiCDn  on  Non-Traditional  Study, 
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^^^73),   adult  individualized  programs   (Houle,    1973;  Medsler, 
19/5),   aud  interdisciplinary  learning  programs  (Veysey, 
1973;   Change  Magazine  Press,   1979).   However  outside  of  the 
area  o-f   higher  education,   the  adult   learner  has  been  a 
subject  o-f  research  -for   the  past  30  years.    The  results  o-f 
tins  study  may  be  use-ful    in  pointing  new  directions  -for 
research   in  the  relationship  o-f   age  to  instructional 
j>*Lrategies.   A  strong  recommendation  -follows  -for  systematic 
investigation  o-f   the  age  -factor  and  advance  organizer  and 
concept  elabo'-ation ,   as  well   as  relationships  o-f 
instructional   strategies   for  traditional   and  non-traditional 
learning  populations   (i.e.    non-college  adult  learners, 
coMege  degree  adult  learners). 
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Abstoci 

In  this  study,  the  effects  of  explicit  versus  general  orienting  strategies  and  varied  access 
time  on  the  learning  of  facts  and  inferences  were  studied,  A  CAI  lesson  focusing  on 
fictionalized  science  concepts  was  presented.  Students  were  randomly  assigned  to  cither  a 
cognitive  or  behavioral  embedded  orienting  strategy  group,  receiving  CAI  which  used  either 
10  or  30  seconds  of  access  time  to  branch  to  lesson  segments.  Orienting  strategies  were 
presented  throughout  the  lesson,  and  addressed  criterion  information  either  explicitly  or  in 
more  general,  abstract  terms.  Upon  completion  of  the  lesson,  students  were  administered  a 
posttest  measuring  both  factual  and  inferential  learning.  Results  indicated  that  orienting 
strategy  erplicitness  did  not  affect  the  learning  of  either  facts  or  inferences  differentially,  A 
marginal  effect  was  found  for  access  time,  with  students  performing  best  with  30  seconds. 
The  results  suggest  that  differences  in  orienting  strategies  may  not  be  as  important  as 
sufficient  time  for  strategy  utilization. 
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THE  EFFECTS  OF  PRESENTATION  LATENCY  AND  EMBEDDED  ORIENTING 
STRATEGIES  ON  LEARNING  FROM  COMPUTER-BASED  INSTRUCTION 

Each  new  instructional  technology  brings  with  it  the  potential  to  solve  current  educational 
problems.  In  many  instances,  the  expected  contributions  to  education  never  materialize.  The 
reason  for  for  these  unfulfilled  expectations  is  not  faulty  technology  per  sc  but  the  way  new 
technologies  are  incorporated.  One  recent  computer-based  instructional  technology  is 
interactive  video.  Floyd  defined  instructional  interactive  video  as  "...  any  video  program  in 
which  the  sequence  and  selection  of  messages  is  determined  by  user's  response  to  the  material" 
(Floyd,  1982,  p.2).  During  the  past  few  years,  interactive  video  has  been  the  subject  of 
increased  interest  and  utilization  for  instructional  applications  (Hannafin,  Garhart,  Rieber,  & 
Phillips,  1985).  However,  this  growing  interest  is  founded  in  very  little  research  from  which  to 
develop  guidelines.  To  obtain  optimum  results  from  this  technology,  research  must  be 
performed  from  which  empirically  based  guidelines  can  be  developed  (Dwyer,  1985; 
Hannafin,  1985). 

A  current  concern  involves  the  type  of  video  delivery  system  best  suited  to  interactive 
video:  videodisc  or  videotape.  The  videodisc  is  considered  by  some  to  be  the  most  significant 
breakthrough  in  instructional  technology  since  the  invention  of  the  printing  press  (Reigeluth  & 
Garfield,  1984).  Because  of  the  ability  of  videodisc  to  access  video  segments  randomly  and  at 
much  greater  speeds  than  videotape,  it  is  considered  by  many  to  be  superior  for  interactive 
video  (Hoffos,  1983). 

If  speed  of  access  were  the  prime  consideration,  videodisc  would  indeed  be  the  superior 
technology.  However,  other  factors  must  be  considered.  For  example,  there  are  limits  to  the 
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rate  at  which  learners  can  process  informati.  x  Providing  learners  with  more  information  than 
they  can  process  effectively  may  inhibit  learning  (Travers,  1982).  Delays  in  access  time 
between  lesson  segments  of  a  lesson  may  provide  an  opportunity  for  the  learner  to  process 
information  (cf.  Chu  &  ^chram,  1967).  Delays  might  also  be  utilized  to  present  meaningful 
information  or  instructions,  such  as  ac  ancc  organizers,  to  improve  learning  and  letention 
(Stone,  1983). 

In  effect,  the  "access  time"  issue  may  be  more  a  learning  and  procesf  Ing  thari  a  •^hnology 
issue.  Since  the  principal  issue  in  the  tape  vs.  disc  arguement  pertains  to  access  time,  perhaps 
the  study  should  center  initially  on  time  and  processing  variable .  in  lei  ^ing  from  ary 
computer-based  lesson  (Hannafin  &  V  zghes,  1986). 

Processing  of  information  requires  sufficient  time  to  select,  encode,  and  integrate 
(Tennyson,  Christensen,  &  Park,  1984).  When  individuals  are  provided  more  information 
than  able  to  process,  they  became  disorganized,  to  the  point  of  being  unable  to  process 
information  at  all  (Travers,  1982).  Rest  times  between  portio-  of  video  instructions  increase 
learning  by  providing  information  process  time  (Chu  &  Schr^  im,  1975).  From  this  research, 
it  can  be  concluded  that  processing  time  is  often  useful  in  improving  learning. 

Delayed  access  time  between  lesson  segments  could  be  utilized  to  present  aavance 
organizing  strategies  to  the  learner.  In  a  meta-analysis  of  1 12  studies.  Stone  (1^83)  found  that 
advance  organizers  were  associated  with  increased  comprehension  and  retention  of  material  to 
be  learned.  The  use  of  "concrete"  advance  organizers  have  had  a  strong  effect  upon  the 
learning  and  retention  of  specific  infoimation  (Mayer,  r\,4).  Explicit  strategies  aid  in  the 
learning  of  cued  information,  but  inhibit  the  learning  of  uncued  inibrmation. 

The  purpose  of  this  study  was  to  examine  the  effects  on  learning  of  presentation  access 
latency,  organizing  strategics,  and  the  combination  of  latency  and  strategy.  Specifically,  the 
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effects  of  behavioral  and  cognitive  organizing  strategies  and  varied  processing  intervals  on 
factual  and  inferential  learning  were  studied. 

Methods 

The  subjects  were  49  college  upper-division  undergraduate  and  graduate  students 
enrolled  in  computer  literacy  courses.  Students  participated  during  a  regularly  scheduled 
class  session  and  were  provided  extra  credit  for  participation. 
Materials 

The  instructional  treatments  were  modified  versions  of  a  computer*assisted  instruction 
(CAI)  lesson  which  was  initially  developed  for  a  previous  research  study  (see  Garhart  & 
Hannafm,  1986).  The  lesson  described  the  discovery  of  a  fictitious  element  on  a  fictitious 
island,  and  the  scientific,  cultural  and  political  ramifications  of  the  discovery  on  a  previously 
primitive  society.  The  lesson  was  presented  as  ?.  factual  account  of  the  discovery:  students 
were  not  informed  as  to  the  fictitious  nature  of  the  lesson  until  the  study  was  completed. 
This  lesson  was  chosen  for  the  following  reasons:  1)  the  fictitious  content  was  plausible  and 
thus  eliminated  the  effects  of  prior  learning;  and  2)  the  relative  ease  with  which  factual  and 
iVifciential  test  items  could  be  identified 

Three  orienting  strategies  were  developed:  1)  instruction  with  embedded  behavioral 
orienting  strategies;  2)  instruction  with  embedded  cog  .twe  orienting  strategies;  and  3) 
instruction  with  prompts  for  the  learner  to  use  individual  learning  strategies. 

L>ehaviora1  orienting  strategy.  This  strategy  oriented  the  student  with  prompts  which 
were  specifically  related  to  the  factual  content  of  the  lesson  segment  which  followed.  The 
prompts  provided  the  learner  a  specific  orientation  to  the  factual  material  subsequently 
assessed.  The  strategy  consisted  of  a  single  computer  frame,  directing  the  student  to  attend 
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to  two  specific  informational  items  which  included  subsequent  lesson  text.  One  f,xample  of 
this  strategy  is:  "In  the  next  section  be  sure  to  learn  this  information:  When  the 
anthropologists  began  arriving  on  Jexium  Island"  These  factual  items  consisted  of  names  of 
people,  places,  specific  events,  and  other  details  presented  during  the  following  lesson 
segment. 

Cognitive  oricntinf  strategy.  This  strategy  oriented  the  student  with  broader,  more 
abstract  proinpting  to  the  instruction  which  followed.  These  prompts  were  not  tied  to 
specific  facts,  but  were  designed  to  provide  a  broader  contextual  orientation  to  the  content 
which  followed.  The  strategy  consisted  of  a  computer  frame  directing  the  student  to  consider 
two  general  concepts  which  were  to  follow  in  the  lesson  text  An  example  of  this  strategy  is: 
In  the  next  section,  you  will  be  presented  information  about:  The  importance  of  studying 
cultures." 

Individual  orienting  sfrategv.  This  strategy  provided  no  prompts  to  direct  student 
attention  to  lesson  information.  Instead,  the  strategy  simply  advised  the  students  to  pay  close 
attention  to  the  information  which  followed.  An  example  of  this  strategy  is:  "In  the  next 
section,  try  your  best  to  learn  the  information."  As  in  the  prior  tw^  cases,  three  strategy 
frames  were  given  before  questioning. 

All  treatment  strategies  were  embeddea  a  identical  lesson  locations.  Each  strategy  was 
presented  in  two  access  time  versions:  10  seconds  and  30  seconds.  The  strategy  remained 
on  the  screen  during  the  access  interval  and  the  computer  ignored  student  input  during  the 
allotcd  processing  time. 

An  introductory  section  was  included  to  obtain  general  information  concerning  student 
identification,  gender,  age,  and  study  preferences.  The  student  was  also  given  a  general 
orientation  as  to  the  nature  and  organization  of  the  lesson  as  well  as  directions  for  answering 
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the  questions  on  the  computer. 

The  lesson  consisted  of  four  parts.  Each  part  consisted  of  10  to  14  text  frames  of  easy  to 
read,  double-space  paragraphs.  Six  graphic  displays  which  supported  the  thematic  content 
of  the  lesson  were  also  included  at  various  points,  but  were  not  related  to  specific  criterion 
information.  The  orienting  strategies  w^rc  embedded  at  three  evenly  spaced  intervals  during 
each  of  the  four  parts* 

Each  part  was  followed  by  six  questions:  three  factual  type  and  three  inferential.  The  24 
embedded  questions  also  served  as  posttest  items.  Feedback  was  not  provided  after  any  of 
the  questions,  either  during  the  lesson  or  the  posttest 

Each  part  of  the  lesson  began  with  a  banner  page  which  was  displayed  for  3  seconds. 
The  first  orienting  strategy  frame  was  th^m  displayed  tor  either  10  or  30  seconds.  This  was 
followed  by  four  to  six  frames  of  instruction.  This  sequence  was  repeated  two  additional 
times.  The  student  was  then  presented  i\  transition  frame  explaining  that  the  lesson  part  had 
concluded  and  that  six  questions  would  follow.  After  answering  these  open-ended,  short 
answer  type  questions,  the  student  ^vas  presented  with  the  next  banner  frame  for  the  next 
lesson  part.  This  cycle  was  repeated  for  all  four  lesson  parts. 

At  the  conclusion  of  the  lesson,  the  student  was  given  a  transition  frame  explaining  the 
posttest.  The  posttest  presented  all  24  embedded  questions,  but  in  random  order.  The 
student  was  continually  informed  of  the  number  of  questions  remaining  in  the  posttest. 
Additional  prompts  were  given  one-third  and  two-thirds  through  the  posttest.  At  the  end  of 
the  posttest,  the  students  were  informed  of  the  fictitious  nature  of  the  lesson  and  were 
directed  to  signal  the  proctor  that  the  lesson  was  completed. 
Dependent  Measures 

Embedded  postadjunct  questions.  Each  of  the  four  parts  of  the  lesson  vvas  followed  by 
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six  postadjunct  questions:  three  factual  and  three  inferential.  These  were  open  ended,  short 
answer  questions.  Factual  questions  measured  recall  of  information  presented  during  the 
lesson;  the  inference  questions  assessed  the  accuracy  of  conclusions  based  on  lesson  content. 
Reliability  was  .91  for  the  factual  scale,  and  .81  for  the  inference  scale.  Validity  was 
established  through  test  item-lesson  congruence  and  review  by  four  evaluators. 

Posttest.  The  24  item  posttest  was  a  repetition  of  the  four  groups  of  six  embedded 
questions  presented  in  a  random  order. 

Student  response  time.  Time  required  by  students  to  answer  each  of  the  two  types  of 
questions,  adjunct  and  postiest,  was  also  collected  and  collated  by  scale:  factual  and 
inferential.  Response  time  was  calculated  by  the  computer  and  rounded  to  the  nearest 
second. 
Procedures 

Students  were  randomly  assigned  to  one  of  the  six  treatments  upon  arrival  to  class.  All 
students  were  given  an  instruction  sheet  which  was  summarized  briefly  by  the  proctor.  Each 
student  was  assigned  a  microcomputer  terminal  and  given  a  computer  diskette  in  accordance 
with  their  treatment  group.  Participants  completed  the  lesson  and  posttest  at  their  own  rate, 
signaling  the  proctor  when  finished.  During  the  study,  all  data  were  collected  and  recorded 
on  separate  diskettes. 

The  study  was  conducted  during  three  sessions  spanning  a  four-day  period.  Students 
completed  the  study  in  times  ranging  from  approximately  45  to  105  minutes.  In  order  to 
avoid  possible  contamination  between  the  sessions,  students  were  briefed  following  their 
participation  and  urged  no*  to  discuss  any  portions  of  the  lesson  until  completion  of  the 
study.  Also,  the  students  were  randomly  assigned  to  the  treatments  during  each  day  of  the 
study  in  order  to  randomize  possible  contamination  effects  over  time. 
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Results  and  Dis:ussion 


Learning  Effects 

The  mean  percent  accuracy  and  standard  deviations  for  both  the  embedded  questions  and 
the  posttest  are  contained  in  Table  1.  Marginally  significant  jffects  were  obtained  for  access 
time,  E(l>43)=2.92,  i2<.10.  Students  provided  30  seconds  of  controlled  access  time  to 
utilize  the  orienting  strategy  performed  slightly  better  overall  than  those  given  10  seconds. 
This  effect  was  consistent  across  orienting  strategy,  although  the  magnitude  of  the  effect  was 
modest. 


Marginal  differences  were  also  found  between  en-route  performance  on  embedded 


of  this  effect,  however,  was  not  anticipated.  Student  performance  on  posttest  items  was 
slightly  better  than  on  the  embedded  questions  during  instruction.  Since  the  embedded 
questions  did  not  include  either  feedback  or  remediation,  this  effect  cannot  be  attributed  to 
either  correction  or  confirmation  resulting  from  practice.  Instead,  the  effect  was  likely 
attributable  to  the  cuing  function  served  by  the  question.  En-route  questions  appear  to  cue 
students  to  presumably  important  lesson  information.  The  inclusion  of  a  question  appears  to 
direct  students  to  retain  the  information  contained  in  the  question,  while  permitting  them  to 
ease  coguitive  overload  by  either  forgetting  or  attending  less  to  non-questioned  information. 

Although  an  orienting  strategy  main  effect  was  not  found,  an  orienting  stratcgy-by-test 
scale  interaction  was  detected,  E(2,43)=4.08,  ji<.05.  This  interaction,  illustrated  in  Figure 
1,  was  characterized  by  better  performance  for  the  cognitive  and  behavioral  strategies  for 


Insert  Table  1  About  Here 


questions  and  the 


x)nding  items  on  the  posttest,  E(l,43)=2.62,  i2<.10.  The  direction 
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factual  versus  inferential  learning,  while  the  individual  strategy  was  most  effective  for 
inferential  versus  factual  learning. 


Insert  Figure  1  About  Here 


Response  Time 

Means  and  standard  deviations  for  response  times  are  contained  in  Table  2.  As  shown, 
the  time  required  to  respond  declined  significantly  from  the  embedded  to  the  posttest, 
E(l,43)=96.65,  c<.(X)01.  This  may  be  due  to  the  familiarity  of  students  with  the  items 
contained  in  both  embedded  questions  and  posttest  portions  of  the  study.  It  it  also  possible 
that  students  were  simply  more  confident  of  their  responses  during  the  posttest,  and 
responded  more  rapidly. 


Insert  Table  2  About  Here 


Students  also  responded  more  rapidly  to  factual  versus  inferential  questions, 
E(1,43)=80.16,  c<.0001.  The  level  of  learning  and  processing  required  for  the  retrieval  of 
sufficient  information  to  permit  inference  could  contribute  to  the  observed  differences. 
Vickers  and  Packers  (1982)  posited  a  cognitive  complexity  paradigm.  Conclusions  that 
involve  greater  evaluation  of  "below-surface"  information  integrated  within  existing  cognitive 
networks  require  greater  time  to  rttrieve.  This  is  likely  to  be  the  case  for  inferential  tasks, 
where  several  pieces  of  learned  information  must  be  evaluated  concurrently  in  order  to  form 
conclusions.  Conversely,  learning  that  is  more  explicitly  defined,  such  as  factual  recall. 
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would  be  correspondingly  easier  to  recall,  requiring  less  time  to  retrieve,  (cf  Vickers  & 
Packers,  1982). 

In  addition,  a  test  interval-by-test  scale  interaction  was  also  significant, 
F(l,43)=21.95,  c<,(X)01.  This  interaction,  shown  in  Figure  2,  was  characterized  by  a 
regression  toward  the  mean  during  the  posttest.  Inferential  questions  still  required 
significantly  more  time  to  answer,  but  the  differences  in  response  time  from  embedded  to 
posttest  items  was  not  uniform. 


Insert  Figure  2  About  Here 


General  Discussion 

The  results  suggest  that  within  the  limits  of  this  study  greater  access  time  improve  learner 
performance.  This  appear?  to  be  true  regardless  of  the  type  of  orienting  ^.trategy  present. 
This  is  inconsistent  with  research  by  Belland,  et  al  (in  press),  who  suggested  that  reductions 
in  allotted  processing  time  tends  to  intensify  effort  and  improve  learning.  Since  only  two 
processing  times,  10  and  30  seconds,  were  studied  it  remains  to  be  seen  if  this  difference 
would  continue  beyond  30  seconds,  and  if  so,  how  far. 

Another  implication  of  this  study  pertains  to  the  role  of  embedded  questions  as  an 
organizational  strategy.  Embedded  questions  seem  to  provide  an  additional  cue  with  which 
to  organize  and  retrieve  both  factual  and  inferred  lesson  material.  This  contention  is 
supported  by  the  decrease  '  .  ^aponse  time  during  the  posttest.  Since  posttest  questions 
were  identical  in  form  to  the  embedded  questions,  students  were  akieady  familiar  with  the 
style  and  content  of  the  posttest.  It  is  also  possible  that  students  gained  insight  to  questions 
answered  incorrectly  on  the  embedded  questions  as  they  continued  through  the  lesson,  thus 
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correcting  mistakes  made  during  the  lesson. 

The  increased  time  necessary  to  answer  inferential  questions  1j  not  surprising.  Retrieval 
time  for  questions  which  require  higher  level  cognitive  tasks  should  generally  be  greater  than 
for  tasks  which  required  only  a  lower  level  cognitive  task,  such  as  factual  recall  (Vickers  & 
Ppcke.s,  1982). 

The  surprising  result  found  in  this  study  was  the  general  lack  of  differential  effect 
attributable  to  orienting  strategies.  It  was  hypothesized  that  students  in  the  cognitive 
orienting  strategy  group  would  generally  perform  better  than  the  other  two  groups,  especially 
on  inferential  questioning.  However,  this  was  not  found  in  this  study.  An  crplanation  for 
this  comes  from  Carlson,  Kincaid,  Lance  &  Hodgson  (1976),  who  noted  that  students  tend 
to  revert  to  their  own  individual  strategies  regardless  of  how  they  arc  prompted  during 
instruction.  If  this  is  the  case,  orienting  strategies  would  all  assume  the  characteristics  of  a 
'*use  your  own"  strategy.  This  might  account  for  why  access  time  resulted  in  more 
noticeable  effects. 

Several  directions  for  further  research  arc  indicated.  The  study  of  access  time  needs 
further  refinement  in  order  to  expand  the  contention  that  increases  in  time  aids  learning. 
Also,  further  research  is  necessary  to  determine  if  a  ceiling  level  for  processing  time  exists, 
and  if  so,  the  relationship  between  access  time  limits  and  different  cognitive  tasks.  Further 
research  is  also  needed  to  study  whether  or  not  students  use  imposed  orienting  strategics,  or 
if  they  simply  revert  to  individual  strategies  acquired  over  time.  It  would  also  be  of  interest 
to  study  developmental  influences  with  yoang  subjects,  since  they  may  not  be  as  likely  to 
have  highly  refined  existing  cognitive  strategies  to  rely  upon. 

This  study  has  raised  several  questions  concerning  how  students  learn  from 
computer-based  instruction.  Based  on  this  study,  we  can  tentatively  conclude  that  students 
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may  profit  from  increases  in  access  time  to  process  instruction,  and  that  the  computer's 
potential  for  rapid  access  may  need  to  be  controlled  to  ensure  adequate  processing  time. 
Further  research  should  clarify  the  roles  of  orienting  strategies  and  cognitive  processing  time 
in  supporting  learning. 


338 


Orienting  Strategies 
14 

REFERENCES 

Belland,  J.,  Taylor,  W.,  Canelos,  J.,  Dwyer,  F.,  &  Baker,  P.  (in  press).  Is  the  self-paced 
instructional  program,  via  micro-computer  based  instruction,  the  most  effective  method 
of  addressing  individual  learning  differences?.  Educational  Communication  and 
Technology  Journal 

Carlson,  R.  F.,  Kincaiu,  J.  P.,  Lance,  S.,  &  Hodgson,  T.  (1976).  Spontaneous  use  of 
mnemonics  and  grade  point  average.  Journal  of  Psychology.  21, 1 17-122. 

Chu,  G.  C.  &  Schramm,  W.  (1967).  Jjcaming  from  television:  What  the  research  savs  ( pp. 
31-32 ).  Washington  D.C.:  National  Association  of  Educational  Broadcasters. 

Dwyer,  F.  (1985).  AECT  President:  technology  instruction  begs  for  more  research.  Tech 
Trends,  30,  9. 

Floyd,  S.  (1982).  Handbook  of  interactive  video  (p.  2).  New  York:  Knowledge  Industry 
Publications,  Inc. 

Garhart,  C.  &  Hannafm,  M.  J.  (1986-February).  The  accuracy  of  student's  comprehension 
monitoring  during  computer-based  instruction.  Presented  at  the  annual  meeting  of  the 
Association  for  the  Development  of  Computer-Based  Instructional  Systems,  New 
Orleans. 

Hannafm,  M.  J.,  (1985).  Empirical  issues  in  the  study  of  interactive  video.  Educational 

Communication  and  Technology  Journal. 
Hannafin,  M.  J.,  Garhart,  C,  Rieber,  L.  P.,  &  Phillips,  T.  L.  (1985).  Keeping  Interactive 

video  in  perspective:  Tentative  guidelines  and  cautions  in  the  design  of  interactive  video. 

In  E.  Miller  and  M.L.  Mosley  (Eds.)  Educational  Media  and  Technology  Yearbook. 

Denver:  Libraries  Unlimited. 
Hannafin,  M.  J.  &  Hughes,  C.  W. (1986-February).  Utilizing  orienting  strategjes  in  the 


ERLC 


33.9 


Orienting  Strategics 
15 

design  of  computer-based  interactive  video.  Presented  at  the  annual  meeting  of  the 
Association  for  the  Development  of  Computer-Based  Instructional  Systems,  New 
Orleans. 

Hoffos,  S.  (1983) .  Interactive  video.  Cheshire:  Sigma  Technical  Press. 

Mayer,  R.  E.  (1984).  Aids  to  text  comprehension.  Educational  Psvcholofv,  19(1),  30-42. 

Reigeluth,  C.  M.,  &  Garfield,  J.  M.  (1984).  Using  videodiscs  in  instruction:  Realizing  their 

potential  through  instructional  design.  Videodisc  and  Optical  Disk,  4(3),  199-214. 
Stone,  C.  L.  (1983\  A  meta-analysis  of  advance  organizer  studies.  Journal  of  Experimental 

Edll£aim,5(4),  194-199. 
Tennyson,  R.  D.,  Christensen,  D.  L.,&  Park,  S.  I.  (1984).  The  Minnesota  Adaptive 

Instructional  System:  An  intelligent  CBI  system.  Journal  of  Computer-Based 

Instruction.  2-13. 

Travers,  R.  M.  (1982).  Essentials  of  learning.  New  York:  Macmillan  Publishing  Co.,  Inc. 
Vickers,  D.,  &  Packers,  J.  (1982).  Effects  of  attending  set  for  speed  or  accuracy  on 

response  time,  accuracy,  and  conHdence  in  a  uni-dimensional  discrimination  task. 

ACTA  Psvchologica.  50.  179-197. 


340 


Orienting  Strategies 
16 

Table  1. 

Mean  Percent  Accuracy  and  Standard  Deviations  for  Fact  and  Inference  Scales  on  Embedded 
Questions  and  Posttest. 


Processine  Time 

Copnitive  Processinf  <?trategv 
Behavioral   Cognitive  Own 

Totals 

Embedded  Questions 

Facts 


10" 

Mean 

70.1 

68.3 

64.4 

67.7 

(SD) 

(8.1) 

(17.2) 

(27.3) 

(18.2) 

30" 

Mean 

72.1 

67.3 

79.8 

73.1 

(SD) 

(17.9) 

(21.3) 

(10.8) 

(17.3) 

Totals 

Mean 

71.0 

67.8 

72.1 

70.3 

(SD) 

(13.2) 

(18.7) 

(21.6) 

(17.8) 

fiference^ 

10" 

Mean 

54.5 

69.3 

65.9 

62.9 

(SD) 

(21.8) 

(11.8) 

(17.3) 

(18.2) 

30" 

Mean 

59.1 

76.1 

77.3 

70.8 

(SD) 

( 12.9) 

(11.8) 

(16.8) 

(15.9) 

Totals 

Mean 

56.7 

72.7 

71.6 

66.8 

(SD) 

( 17.8) 

(11.9) 

(17.5) 

(17.4) 
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Table  1  (cont) 


Proce^sini?  Time 

Cognitive  Processing  5?fraf^pY 
Behavioral   romiHve  Own 

Totals 

Posttest  Questions 

Facts 


10" 

Mean 

70.1 

65.4 

64.4 

66.8 

(SD) 

(9.8) 

(16.4) 

(27.3) 

(18.4) 

30" 

Mean 

74.0 

71.2 

83.7 

76.3 

(SD) 

(16.9) 

(19.6; 

(13.3) 

(17.0) 

Totals 

Mean 

72.0 

68.3 

74.0 

71.4 

(SD) 

(13.3) 

(17.7) 

(23.1) 

(18.2) 

Inferences 


10" 

Mean 

61.6 

71.6 

67.0 

66.5 

(SD) 

(23.1) 

(17.1) 

(21.1) 

(20.3) 

3a' 

Mean 

59.1 

78.4 

77.3 

71.6 

(SD) 

(12.9) 

(16.1) 

(16.8) 

(17.2) 

Totals 

Mean 

60.4 

75.0 

72.2 

69.0 

(SD) 

(18.4) 

(16.4) 

(19.2) 

(18.8) 
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Table  2. 

Means  and  Standard  Deviations  for  Response  Time  Per  Ttem  for  Fact  ai.ri  Inference  Oiiesrionfs 
Durin'T  Embedded  Oiiffstinning  and  Posttest 

Cognitive  Processing  .Sfrafegv 

Processing  Time  Behavioral    Cognitive   Own  Totals 

Enribedded  Questions 


Facts 

10"           Mean  19.7 

(SD,  (8.1) 

3C"           Mean  20.7 

(SD)  (7.2) 

Totals       Mean  20.2 

(SD)  (7.5) 

Inferences 

10"          Mean  25.3 

(SD)  (7.7) 

30"         Mean  26.9 

(SD)  (14.3) 

lotals      Mean  26.1 

(SD)  (11.0) 


19.2 

22.6 

20.4 

(10.2) 

(5.6) 

(8.0) 

19.9 

20.8 

20.5 

(7.2) 

(8.2) 

(7.3) 

19.5 

21.7 

20.5 

(8.6) 

(6.9) 

(7.6) 

28.3 

33.v' 

29.0 

(6.0) 

(8.6) 

(9.8) 

30.6 

29.4 

29.0 

(12.8) 

(15.4) 

(13.7) 

29.5 

31.6 

29.0 

(9.8) 

(12.3) 

(11.1) 
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Table  2  (cont) 


Cognitive  Processing  .■Strategy 

Processing  Time  Behavioral   Cognitive   Own  Totals 

Posttest  Questions 


Facts 


10" 

Mean 

15.6 

11.7 

14.5 

14.0 

(SD) 

(6.1) 

(4.5) 

(2.8) 

(4.8) 

30" 

Mean 

13.7 

13.9 

12.9 

13.5 

(SD) 

(4.1) 

(3.1) 

(2.9) 

(3.3) 

Totals 

Mean 

14.7 

12.8 

13.7 

13.8 

(SD) 

(5.2) 

(3.9) 

(2.9) 

(4.1) 

iferencgs 

10" 

Mean 

18.4 

17.9 

18.9 

18.4 

(SD) 

(5.5) 

(2.7) 

(5.2) 

(4.5) 

30" 

Mean 

18.3 

18.5 

i7.9 

18.2 

(SD) 

(8.0) 

(5.5) 

(f.5) 

(6.4) 

"^otals 

Mean 

18.3 

18.2 

18.4 

18.3 

(SD) 

(6.6) 

(4.2) 

(5.7) 

(5.5) 
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Percent 
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ABSTRACT 

The  purpose  of  this  exploratory  study  was  to  examine  the  potential 
interactions  between  the  media  attribute,  horizontal  screen  placement,  and 
the  cognitive  aptitudes,  fluid  ability  and  visualization.  Treatments 
included  three  versions  of  a  videotaped  program  (left,  central,  or  right) 
that  were  identical  in  every  respect  with  the  exception  of  ten  visual 
stimuli.    Stepwise,  multiple  linear  regression  was  utilized  to  investigate 
the  major  hypotheses  with  the  Group  Embedded  Figures  Test,  the  Advanced 
Progressive  Matrices  Test  (APM),  APM  subtests  I  and  II,  sex,  age,  and  all 
possible  in c  Tactions  forming  the  predictor  variables  (5^=252).  The 
resulting  equation  revealed  a  highly  significant  F  ratio  with  14 
significant  interactions  accounting  for  54  percent  of  the  total 
variability.    Sex  and  age  interactions  were  noted.    Alternative  treatments 
promoted  improved  performance  for  many  low- ability  learners  but  actively 
diminished  performance  for  many  high-ability  learners  and  vice  versa.  The 
implications  of  this  study  have  affirmed  the  need  for  future  research 
incorporating  additional  cognitive  factors  and  alternate  media  attributes. 
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Recent  discussion  has  surfaced  in  regard  to  the  role  of  confounding 
effects  in  visually-based  media  research.    Clark  (1983)  has  asserted  media 
do  not  influence  learning  under  any  conditions,  but  rather  the 
instructional  method  employed  is  the  crucial  factor  which  fosters  learning. 
A  second  rival  hypothesis  offered  by  Clark  is  that  the  increased  attention 
paid  by  students  to  media  may  result  in  increased  effort  or  persistence 
which  yields  achievement  gains.    Clark's  argument  is  based  upon  the  small, 
but  positive,  effects  of  student  achievement  found  in  meta-analysis  (Cohen, 
Ebeling,  &  J.  Kulik,  1981;  C.  Kulik,  J.  Kulik,  &  Cohen,  1980;  J.  Kulik, 
Bangert,  &  Williams,  1983;  J.  Ktilik,  C.  Kulik,  &  Cohen,  1979).  Clark 
(1984a,  i984b)  has  continued  to  insist  that  media  attributes  do  not 
influence  learning  in  unique  ways.     Further,  Clark  and  Salomon  (1985,  p. 
A7A)  have  advanced,  "Any  new  technology  is  likely  to  teach  better  than  its 
predecessors  '  acaase  it  generally  provides  better  prepared  instructional 
materials  and  its  novelty  engages  learners." 

In  a  critique  of  Clark's  article  on  learning  from  media,  Petkovich  and 
Tennyson  (1984)  have  noted  the  lack  of  consideration  for  how  the  operation 
of  the  various  components  of  the  human  information  processing  system  affect 
learning.    The  need  for  consideration  of  processing  demands  has  been 
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highlighted  by  research  -.hich  has  shown  that  individuals  are  likely  to 
perform  better  in  tasks  in  which  they  are  suited  by  their  cognitive  style 
(Cronbach  &  Snov.  1977;  Witkin,  Moore,  Goodenough,  &  Cox,  1977).  Snow 
(1977)  first  postulated  an  intercorrelational  paradigm  of  general  ability 
(G)  which  incorporated  human  performance  characteristics.    Following  the 
hierarchical  model  of  ability  organization  interpreted  by  Cattell  (1971) 
and  extended  by  Horn  (1976),  Snow  (1980)  noted  the  relation  of  crystallized 
ability  (G^)--a  constellation  of  measures  of  verbal  knowledge,  reading 
comprehension,  and  prior  educational  achievement- -to  learning  outcomes  is 
strongest  in  conventional  instructional  treatments.    When  such  an 
instructional  treatment  is  modified  to  reduce  the  need  for  conventional 
assembly  and  control  processes,  the  relation  of  G^  to  learn  outcomes  goes 
down.    Fluid  ability  skills  (G^)— a  constellation  consisting  of  abstract 
and  often  nonverbal  reasoning  tests  and  some  spatial  and  figural  tests- 
should  relate  to  learning  outcomes  under  instructional  conditions  that  are 
in  some  sense  new,  unlike  those  that  the  individual  learner  has  faced  in 

the  past.    Ability  to  apply  previously  crystallized  learning  skills  (G  ) 

c 

would  not  be  relevant  here,  but  ability  to  adapt  to  new  kinds  of  learning 
or  performance  requirements  (G^)  would  be  relevant.     Snow  (1980,  p.  59) 
predicted,  "...that  as  an  instructional  situation  involves  combinations  of 
new  technology  (e.g.,  computerized  instruction  or  television) .. .G^  should 
become  important  and  G^  less  important." 

The  dist.  ction  between  "visualization"  (G^)--a  constellation  of 
figural  and  spatial  relations  tests  in  which  the  Group  Embedded  Figures 
Test  (Witkin,  Oltman,  Raskin,  &  Karp,  1971)  is  frequently  included--anc' 

Is  often  difficult  to  make,  because  they  appear  separable  in 
multidimensional  scaling  but  not  in  factor  analysis.    G^  and  G  are 
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separable  at  times,  with  some  measures,  and  in  some  populations.  Often, 
however,  the  close  correlation  between  measures  from  each  constellation  ties 
suggested  that  some  individuals,  or  all  individuals,  sometimes  use 
processes  to  perform       tasks.    Extensive  reanalyses  of  figural  and 
spatial  test  batteries,  conducted  by  Lohman  (1979),  have  suggested  that 
spatial  abilities  do  not  fit  neatly  into  a  smoothly  progressive  hierarchial 
factor  model,  as  verbal  and  numerical  abilities  seem  to  do.    Again  it  may 
be  individual  differences  in  the  novel  assembly  and  control  of  spatial 
processing  that  underlie  this  relation,  rather  than  a  basic  relation 
between  fluid-analytic  and  spatial  performance  processes.     Therefore,  G^ 
tests  that  measure  to  a  greater  degree  the  kinds  of  assembly  and  control 
processes  needed  to  organize  on  a  short-tem  basis  adaptive  strategies  for 
solving  novel  problems  should  be  included  in  studies  on  interaction  effects 
on  learner  and  media  attributes.     In  a  radex  topographic  model  of  ability 
test  intercorrelations.  Snow  and  Lohman  (198A)  have  shown  Raven's  (1962) 
Progressive  Matrices  is  in  che  center  of  the  map,  and  is  to  date  one  of  the 
best  measures  of  G  or  G^. 

This  exploratory  study  was' conducted  to  investigate  the  potential 
interaction  between  the  media  attribute  (Salomon,  1979),  "asymmetry  of  the 
screen"  (ZeLtx,  1973),  and  the  cognitive  aptitudes,  fluid  ability  and 
visualization.     Metallinos  (1979)  has  reviewed  the  theoretical  basis  of 
forces  operating  within  the  television  screen  and  has  noted  that,  with  the 
exception  of  a  few  experiments  with  inconclusive  results,  the  investigation 
of  left,  central  and  right  placement  within  the  frame  has  been  largely 
ignored.     While  some  research  has  been  reported,  none  has  shown  any 
cogently  significant  differences  (e.g.,  Avery  &  Tiemers,  1975;  Fletcher, 
1977,  1980;  Herbener,  Van  Tubergen,  &  Witlow,  1979).    Using  a  newscast 
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display  format,  Metallinos  (1980)  obtained  significant  differences  for 
subjects  describing  the  shape,  perceiving  the  color,  and  recalling  visual 
stimuli  placed  on  the  left  side  of  the  screen  over  the  right;  however, 
Niekamp  (1981)  reported  that  mean  fixations  of  test  stimuli  measured  by 
ocular  photography  favored  the  right.    In  regard  to  learning  effects, 
Metallinos  (1975)  and  Metallinos  and  Tiemens  (1977)  have  reported  no 
significant  differences  for  the  retention  of  news  information. 
Nonetheless,  w«irt  (1985)  reported  a  predominant  superiority  for  right 
placement  on  a  simple  concept  task  by  older  females.    A  meaningful 
difference  was  found  for  left  placement  over  the  central  orientation  as 
well,  and  interactions  were  noted.    Field- independent  females  scored 
significantly  higher  than  field-dependent  females,  and  significant 
differences  for  and  between  field  independence  and  field  dependence 
occurred  with  right  placement. 

The  purpose  of  this  research  was  to  ask  whether,  under  the  impact  of 
different  aptitudes,  a  particular  frame  position  (left,  central,  or  right) 
was  warranted.    The  primary  experimental  hypothesis  tested  was  that  low-G 
learners  who  are  without  well  developed  assembly  and  control  operations 
should  perform  more  ably  than  high-G  students  who  may  find  the  visual 
strategies  dysfunctional.    Thus,  the  study  compared  a  media  attribute  that 
differs  in  the  degree  to  which  it  imposed  common  assemblies  on  students, 
seeking  aptitude  by  treatment  interactions  in  which  the  regression  of 
learning  on  G  is  steeper  in  the  treatment  that  is  least  imposing  and 
shallower  in  the  treatment  that  is  the  most  imposing. 
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Subjects 

Students  in  a  central  California  university  enrolled  in  a  multiple- 
section,  "Radio-Television  as  Popular  Culture"  course  were  selected  as 
subjects  for  the  experiment.    The  sample  consisted  of  252  undergraduates 
ranging  in  age  from  17  to  kk  years  (M-22.8,  SD-A.O).    Of  the  total 
group,  129  were  male,  and  123  were  female.    The  ethnic  composition  was 
primarily  Anglo  Ai.-.erican,  with  a  representative  minority  of  Hispanic- 
American,  Afro-American,  and  Asian-Americ-n  students. 
Materials 

Stimuli  and  Criterion  Test.    A  nine-mi/iute  videotaped  program  and 
test  instrument  developed  by  Hart  (1985)  were  employed.    The  program 
contained  ten  simple  concepts  on  sex  role  indicators  which  formed  the  basis 
for  a  visual  stimuli  set  and  a  22-item  criterion  test  (KR2q=.76).  Each 
stimulus  was  constructed  in  three  versions  for  left,  central,  and  right 
screen  placement.    The  three  electronically  edited  experimental  videotapes 
were  identical  with  the  exception  of  the  embedded  stimuli  set. 

Group  Embedded  Figures  Test  (GRFT).    On  the  18-item  perceptual  test 
(Spearman-Brown=.82),  a  field -Independent  person  is  able  to  betrir  locate 
simple  figures  embedded  in  more  complex  designs  than  is  a  field-dependent 
individual  (Witkin.  Oltman.  Raskin,  &  Karp,  1971).    Field  independence 
versus  field  dependence  refers  to  a  consistent  mode  of  approaching  the 
environment  in  analytical,  as  opposed  to  global,  terms  (Messick,  1977). 
The  field- independent  pole  includes  competence  in  analytical  functioning, 
such  as  mathematical  reasoning,  verbal  fluency,  and  spatial  abilities, 
combined  with  an  Impersonal  orientation  and  a  tendency  to  have  self-defined 
goals  and  reinforcements  (Witkin,  Moore,  Oltman,  ^oodenough,  Friedman, 
Owen,  &  Raskin,  1977).    On  the  other  hand,  the  field-dependent  pole 

reflects  correspondingly  less  competence  in  analytical  skills  combined  with 
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greater  social  orientation  and  social  skills  as  well  as  the  need  for 
externally  defined  goals  and  reinforcements  (Goldstein  &  Blackman,  1978; 
Witkin,  Moore,  Goodenough,  &  Cox,  1977). 

Repeated  age  and  sex  differences  have  been  noted  on  the  GEFT.  Mean 
scores  typically  tend  to  be  slightly,  but  significantly,  higher  for  males. 
Consequently,  women,  on  the  average,  are  inclined  to  be  more  field 
dependent  than  men  (Witkin  &  Goodenough,  1981).    Field  dependence  is  also  a 
function  of  age.    At  some  point  after  the  age  of  24,  the  process  of 
increasing  field  dependence  begins  (Witkin,  Oltman,  Raskin,  &  Karp.  1971). 
Significant  decreases  in  GEFT  scoring  across 'the  life  span  have  been 
reported  with  adequate  reliability  and  validity  (Panek,  Barrett,  Sterns,  & 
Alexander,  1978;  Panek,  Funk,  &  Nelson,  1980). 

Advanced  Progressive  Matrices  (APM).    Raven's  test  is  a  widely  used 
set  of  analogical  reasoning  instruments  which  use  geometric  figures 
patterned  after  Spearman's  wall  chart  (Burke,  1958).    Set  I  consists  of 
only  12  problems  and  is  used  to  provide  task  training,  similar  to  the  first 
section  of  the  GEFT.    Set  II  is  administered  immediately  thereafter  and 
consists  of  36  problems,  arranged  in  ascending  order  of  difficulty.  Each 
of  the  36  items  consists  of  a  stimulus  array  in  which  a  3  X  3  figural 
analogy  is  represented  with  a  mi£.sing  piece  in  the  lower  right  portion  of 
the  array.    A  set  of  eight  response  alternatives  is  located  beneath  each 
stimulus  array  (Raven,  1962).    Raven,  Court,  and  Raven  (1977)  have  reported 
a  high  retest  reliability  of  0.91.    The  test  manual  also  noted  a  decline  in 
scoring  as  age  increases,  particularly  after  the  age  of  30.     Panek  and 
Stoner  (1980),  have  reported  a  significant  decrease  in  performance  for  age 
groups  but  no  significant  sex  differences. 
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Several  factor  analytic  studies  have  been  carried  out  with  earlier 
forms  of  the  APM.    The  results  of  these  studies  have  prompted  investigators 
to  conclude  that  the  tests  constitute  a  measure  of  general  intelligence 
ability  or  fluid  G  (MacArthur,  I960;  Olsen  &  MacArthur,  1962;  Spearman, 
1939;  Vernon,  1965a,  1965b).     When  the  Progressive  Matrices  measures  are 
factor  analyzed  along  with  other  tests,  the  evidence  is  supportive  of  a 
high  G  loading  and  relatively  trivial  loadings  on  other  factors.    When  the 
matrices  are  factor  analyzed  by  themselves;  however,  evidence  of  multiple 
factors  emerge  (Carlson  &  Wiedel,  1979;  Coreman  &  Budoff,  197A;  Rimoldi, 
19A8;  Wiedel  &  Carlson,  1976).    Dillon,  Pohli4n,  and  Lohman  (1981)  found  a 
two  factor  solution  to  yield  the  most  interpretable  structure.    The  two 
factors  isolated  in  the  factor  analysis  measured  performance  items  in  which 
a  solution  required  (a)  the  addition  and/or  subtraction  of  elements  or  (b) 
the  ability  to  perceive  the  progression  of  a  pattern.     The  first  subtest  to 
measure  the  pattern  progression  factor  was  formed  by  combining  items  2,  3, 
A,  17,  26,  and  36.    Items  7,  9,  10,  11,  16,  21,  28,  and  35  wera  used  to 
form  a  second  subtest  to  measure  the  addition/ subtraction  factor.  These 
three  researchers  recom-Tiended  subtest  scores  on  the  two  factors  be  included 
in  all  future  studies  predicting  behaviors. 
Procedures 

A  total  of  nine  randomly-assigned  experimental  sessions  were  conducted 
within  a  period  of  one  week  at  the  beginning  of  the  fall  semester.  Each 
session  followed  the  same  format.     As  the  volunteer  subjects  entered  the 
room,  they  were  encouraged  by  the  experimenter  to  seat  themselves  in  close 
proximity  to  a  television  receiver  in  order  that  (a)  no  one  be  farther  away 
than  12  times  the  horizontal  width  of  the  screen,  and  (b)  a  line  of  vision 
of  not  more  than  45  degrees  from  the  center  line  axis  perpendicular  to  the 
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oicture  tube  be  maintained  as  a  maximum  viewing  angle  (Chapman,  1960).  An 
initial  overview  of  the  session  was  provided  with  a  short  description  of 
the  instruments  to  be  completed  and  of  the  videotaped  program  to  be  viewed. 
The  GEFT  and  APM  were  administered,  respectively,  according  to  their  test 
manuals  (Witkin,  Oltman,  Raskin,  &  Karp,  1971;  Raven.  ]962).     Subsequent  to 
the  completion  of  the  cognitive  indices,  one  of  the  three  visual  treatments 
was  administered  and  iram ,diately  followed  by  the  posttest.    Subjects  were 
not  informed  of  the  intended  purpose  of  the  experiment  until  a  short  report 
was  pissented  later  in  the  semester  by  the  participating  course 
ins  :ri:':tors. 

RESULTS 

Group  Equivalence 

Because  the  study  employed  nine  experimental  sessions,  three  for  each 
of  the  three  treatments,  equivalence    of  the  three  combined  groups  was  an 
important  question  to  investigate  prior  to  testing  for  the  experimental 
hypothesis.    A  three  level,  one-way  analysis  of  variance  was  used  in 
analyzing  the  data  between  the  groups  for  each  of  the  following  subject 
background  and  cognitive  variables:     age,  F  (2,249)  =  1,56,  M  =  22.8; 
GEFT,  F  (2,249)  =  .45,  M  =  11.48;  APM,  F  (2,249)  =  1.31,  M  =  17.13. 
Differences  between  sexual  composition  were  analyzed  using  the  independent 
samples  Chi-Square  Test,  X^(2,N=252)  =  2.06.    The  results  showed  no 
significant  differences  between  the  groups  on  any  of  the  variables  at  the 
.05  level  of  significance. 

To  determine  if  the  subjects  had  dissimilar  life-history  experiences 
which  might  have  altered  the  equivalence  of  the  groups,  two  multiple  choice 
questions  on  the  posttert  were  analyzed  using  the  Kruskal-Wallis  o-.o-uay 
analysis  of  variance  for  ranks.    No  significant  differences  were  noted 
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bet'^aen  the  groups  at  the  <05  level  for  subjects  having  re&d  sex  role 
2 

material,  x    (2,N-252)  -  .91,  cr  ha.  ng  had  a  recent  encounter  with  a 
sex  typing  situation,  x"^  (2,N«2!>2)  =  .52.    The  mean  for  both  questions 
was  between  the  last  two  responses,  "over  two  years"  and  "no  encounter." 
Regression  Analysis 

Multiple  regression  analysis  has  become  an  increase  popular 
statistical  technique  (Serlin  &  Levin,  1985).    Cronbach  %nd  Snow  (1977) 
have  noted  that  linear  regression  equations  are  most  useful  in  explorin^j 
aptitude-treatment-inLeraction  designs,  because  the  technique  provider  a 
simple  method  for  establishing  a  functional  relationship  among  variables. 
For  ex-~_jle,  in  an  experiment  with  several  treatments  (a  categorical 
variable),  aptitudes  of  subjerts  (a  continuous  variable)  may  be  used  to 
study  the  interaction  between  the  variables  in  theii  effect  on  a  dependent 
variable. 

Y  =  a  .  b^X^  +  b^X^  +  b3X^X2  .   .  . 
In  :his  study,  the  parameters  of  the  multiple  linear  regression 
equation  for  testing  the  major  hypotheses  were  computed  in  a  stepwise 
manner.    The  independent  or  predictor  variables  were  visual  placement, 
GEFT,  A?M,  APM  Subtest  1,  APM  Subtest  II,  sex,  age,  and  all  possible 
interactions.    Table  1  presents  the  intercorrelations  among  the  main 
variables. 


Insert  Table  1  about  here. 


Two  dummy  variables  were  created  for  visual  placement  (K-1  levels),  l?ft 
placement  and  right  placement,  wl^h  membership  being  assigned  1  anU 
nonmembership  being  assigned  0.    As  a  no  inal  variable,  sex  was  treated 
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similarly  with  males  being  assigned  1  and  females  being  assigned  0  (Cohen  & 
Cohen,  1983).    The  dependent  measure  was  the  22-iteiu  posttest.  The 
Biomedical  Computer  Program  (BMDP2R)  was  utilized  to  facilitate  the 
analysis  (Dixon,  1983). 

Following  the  examination  of  residuals  on  the  initial  attempt,  the 
relationship  was  found  to  be  a  ronlinear  "S"  shape.    The  linearizable 
curve,  the  logistic  response  function,  was  chosen  to  represent  the  date: 
P'^  =ln  yjl'P^),  where  P  was  the  posttest  expressed  as  a 
percentage.    The  logistic  model  has  been  used  extensively  in  biological 
work.    Besides  medicine  and  pharmacology,  the  logistic  model  has  been  used 
in  learning  theory,  the  study  of  consumer  behavior  (response  to 
advertising)  and  market  promotion  studies  (Chatterjee  &  Price,  1977). 

Applying  the  weighted-least-squares  (WLS)  metnod  as  is  required  on  the 

t  -arsformed  logit  variable,  heteroscedastic  residuals  were  observed  on  APM 

Subtest  I  and  APM  Subtest  II.    Heteroscedasticity  is  resolved  by  applying 

variations  of  WLS  (Draper  &  Smith,  1981).    Estimates  of  thp  regression 

coefficient  were  carried  out  using  WLS  with  weights  W    =  l/n^  . 

i  u . 

1 

Thus,  the  ronconstant  residual  variance  was  accounc^d  for  by  case  weights 
associated  with  the  variance  of  the  logistic  response  function,  APM  Subtest 
I,  and  APM  Subtest  II.    Table  2  presents  a  summary  of  the  final  regression 
analysis,  and  Table  3  presents  the  estimated  regression  coefficients. 


Insert  Table  2  and  Table  3  about  here. 


The  stepwise  multiple  regress  on  analysis  yielded  14  significant 
>/ar  iables: 
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Y'  =  -1.28A2  -  .1243X^  +  .OOAeX^  +  .3I87X3  +  .0145X^  + 
I.A898X5  +  .0149Xg  +  .0053X^  +  .3145Xg  - 
.1238Xg  +  .OOOnX^Q    -.00020X^^  +  .0052Xj2  ' 
.0033X^3  "  -OOOISX^^ 
Y'  is  the  predicted  score;  X^  is  the  interaction  of  GEFT  and  sex;  X^  is 
the  interaction  of  GEFT  and  age;  X3  is  the  interaction  of  APM  subtest  I 
and  right  screen  placement;  X^  is  the  interaction  of  sex  and  age;  X^  is 
the  interaction  of  sex  and  right  screen  placement;        is  the  interaction 
of  APM,  APM  subtest  I,  and  left  screen  placement,  X^  is  the  interaction 
of  APM,  APM  subtest  II,  and  sex;  Xg  is  the  interaction  of  APM  subtest  II, 
sex  and  right  screen  placement;  X^  is  the  interaction  of  sex,  Pge,  and 
right  screen  placement;  X^q  is  the  interaction  of  GEFT,  APM,  sex,  and 
age;  X^^  is  the  interaction  of  GEFT,  APM,  APM  subtest  I,  APM  subtest  II, 
and  right  screen  placement;  X^^  is  the  interaction  of  GEFT,  APM  subtest 
i,  APM  subtest  II,  sex,  and  left  screen  placement;  X^3  is  the  interaction 
of  APM  subtest  I,  APM  subtest  II,  sex,  age,  and  left  screen  placement;  and 

is  the  interaction  of  GEFT,  APM  subtest  I,  APM  subtest  II,  age,  and 
left  screen  placement.     In  all, 'five  first-order  interactions,  four  second- 
ordei  interactions,  one  third-order  interaction,  and  four  fourth-order 
interactions  were  entered  into  the  equation.    The  resulting  multiple 
correlation  was  .72  with  a  standard  error  of  estimate  of  .40.     An  F-test  of 
the  multiple  correlation  revealed  F  (14,237)  =  181.17  which  was  significant 
beyond  the  .001  level. 

The  method  of  variable  coding  will  aid  in  the  interpretation  of  the 
interactions.    The  test  of  a  coefficient  is  tantamount  to  testing  the 
difference  between  the  group  assigned  1  in  the  vector  with  which  the 
coefficient  is  associated  and  the  mean  of  the  group  assigned  Os  in  all  the 
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vectors.    The  tests  of  the  coefficient  are  therefore  relevant  when  one 
wishes  to  test,  in  turn,  the  differences  between  the  means  of  each  group 
assigned  1  in  a  given  vector  and  that  of  a  group  assigned  Os  in  all 
vectors.    Dummy  coding  is  not  restricted  to  situations  in  which  there  are 
several  treatment  groups  and  a  control  group.    They  can  be  used  to  code  any 
categorical  variable,  for  example,  sex  (Pedhazur,  1982). 

Two  other  points  are  worth  mentioning.     First,  recall  that  product 
vectors  represent  the  interaction  terms.     Interaction  vectors  are  created 
by  multiplying  the  vectors  representing  the  categorical  variable  by  the 
vector  for  the  continuous  variable.    When  more  than  one  continuous  variable 
is  used,  the  vectors    representing  the  categorical  variable  are  multiplied 
in  turn  by  each  of  the  vectors  for  the  continuous  variables.    This  process 
is  continued  until  all  possible  combinations  are  produced.    Second,  the 
standard  regression  coefficient  may  be  thought  of  as  the  regression 
coefficients  that  would  have  been  obtained  if  the  various  predict 
variables  were  equal  to  one  another  in  terms  of  means  and  standard 
deviation.    The  predictor  variable  that  has  the  largest  standard  regression 
coefficient,  disregarding  whether  the  coefficient  is  positive  negative, 
is  the  best  predictor;  conversely,  a  small  standard  regression  coefficient 
indicates  that  the  corresponding  predictor  variable  is  not  contributing  to 
successful  prediction  as  much  as  the  ether  predictor  variables  (Cohen  & 
Cohen,  1983;  Draper  &  Smith,  1981). 

Applying  the  above,  the  examination  of  the  interactions  will  prove 
most  informative.    Since  sex  was  assigned  by  designating  1  for  males  and  0 
for  females,  the       variable,  GEFT  by  sex,  indicated  GEFT  scores  for  male 
subjects  had  a  significantly  negative  impact  upon  the  prediction  equation 
(£<.00l).    On  the  other  hand,  the  sex  by  age  interaction,  X^,  indicated 
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older  male  subjects  had  a  slightly  higher  predicted  score  (£<.05).  The 
interaction  of  sex  and  right  screen  placement,  X^,  also  indicated  males 
profited  frori  participation  in  this  treatment  group  (£<.05);  however,  the 
higher-order  interaction  of  sex  by  age  by  right  screen  placement,  X^, 
indicated  older  male  subjects  were  dehabilitated  by  participation  in  the 
very  same  group  (£<.001).    The  second-order  interaction  X^  and  the 
first-order  interaction       had  the  two  largest  standard  coefficients, 
-2.19  and  -1.49,  respectively.    Thus,  they  contributed  greatly  to  the 
prediction  equation. 

The  variable  sex  interacted  in  five  other  conditions.    The  AP^.,  APM 
subtest  II,  and  sex  interaction,  X^,  had  a  small  positive  contribu*  *    i  to 
the  prediction  equation  (2<.05).    Male  subjects  who  scored  well  on  tj e 
APM  and  APM  subtest  II  performed  slightly  better  as  a  result.    Sex  also 
interacted  with  APM  subtest  II  and  right  screen  placement,  Xg,  indicating 
males    ith  high  APM  subtest  II  scores  benefited  from  placement  in  that 
treatment  condition  (2<.0l).    Variable  X^g,  the  interaction  of  GEFT, 
APM,  sex,  and  age,  indicated  older  male    who  possessed  high  GEFT  and  /PM 
scores  had  slightly  larger  predicted  scores  (£<.01).     The  higher-order 
interaction  X^^'  ^EFT  by  APM  subtest  I  by  APM  subtest  II  bv  sex  by  left 
screen  placement,  evidenced  high  scoring  males  on  the  cognitive  variables 
profited  from  placement  in  that  treatment  condition  (£<.001),  but  the 
fourth-order  interaction  X^^,  APM  subtest  ^  by  APM  subtest  II  by  sex  by 
age  by  left  screen  placement,  indicated  older  males  who  performed  well  only 
on  the  APM  subtest  I  and  ^      II  were  dehabilitated  by  placement  in  that 
very  same  group  (2<.001).     Variables  X^^  had  almost  equal  but 

opposite  standard  coefficients,  .84  and  -.89,  respectively. 
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Of  the  five  remaining  interaction  variables,  four  included  treatment 

conditions,  and  one  included  a  fiist-order  interaction  with  a  cognitive 

index.    Unlike  variable      ,  GEFT  by  sex.  variable  X^,  GEFT  by  age, 

revealed  GEFT  scores  had  a  small  positive  impact  upon  the  prediction 

equation  when  considering  the  subjects'  age  (£<.001).    In  regard  to  the 

treatment  conditions,  variable  X3,  the  APM  subtest  I  by  right  screen 

placement  interaction,  indicated  that  subjects  with  high  APM  subtest  I 

scores  profited  from  participation  in  that  treatment  (£<.001),  and  the 

interaction  also  had  a  heavy  positive  impact  upon  the  prediction  equation 

with  a  standard  coeff  icier. of  1.12.    On  the 'other  hand,  variable  X^^ 

disclosed  APM  subtest  I  and  right  screen  placement  interacted  at  a  higher 

level  with  GEFT,  APM,  and  APM  subtest  II,  producing  a  slightly 

dehabilitating  effect  in  the  very  same  treatment  for  high  scoring  subjects 

on  all  the  cognitive  variables  (2<.001).    When  considering  left  screen 

placement,  the  interaction  of  APM,  APM  subtest  I,  and  left  screen  placement 

in  variable       had  a  slightly  positive  effect  on  the  prediction  equation 

with  high  scoring  subjects  on  those  measures  being  aided  by  the  placeiient 

condition  (£<.O01).    Again,  the'higher-order  interaction  of  GEFT  by  APM 

subtest  I  by  APM  subtest  II  by  age  by  left  screen  placement,  X  . 

14 

resulted  in  a  slightly  diminishing  effect  for  the  prediction  equation 
(£<.00l).    Yet  on  the  variable,  those  older,  high  scoring  subjects  on 
GEFT,  APM  subtest  I,  and  APM  subtest  XI  were  only  slightly  dehabilitated  by 
that  same  treatment. 

Among  the  14  significant  predictors,  U  contained  cognitive  indices  in 
interaction  terms.    All  the  cognitive  tests  and  subtests  were  represented. 
Nine  of  the  variables  also  contained  screen  placement  treatments.  Of 
these,  five  contained  right  screen  placement  and  four  contained  left  screen 
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placement.    When  considering  those  variables  with  standard  coefficients  of 
approximately  one  or  greater  which  would  have  contributed  the  most  to  the 
prediction  equation,  right  screen  placement  was  contained  in  three  of  the 
four  interactions:  X^,  X^,  and  X^.    Of  the  four  major  predictors, 
cognitive  indices  contributed  only  to  two  interactions:    X^,  GEFT  by  sex, 
and  X^,  APM  subtest  by  right  screen  placement. 

DISCUSSION 

Before  commencing  with  a  discussion  of  the  resulting  data,  a 
circumspection  should  be  observed.    In  interpreting  multiple-regression 
factors  from  an  aptitude-interaction  standpoint,  third-order  and  higher 
interactions  must  be  interpreted  cautiously,  if  at  all,  without  well 
grounded  theory  (Cronbach  &  Snow,  1977).    Unreliability  may  have  especially 
powerful  effects  in  a  multivariate  study.    Index  error,  sampling  error,  and 
sample  size  may  have  produced  anomalies.    Thus,  this  study  should  be 
considered  exploratory  in  nature. 

Performance  on  a  simple  concept  task  presented  via  three  screen 
placements  was  found  to  possess  a  significant  aptitude-treatment  prediction 
equation,  although  age  differences  and  sex  differences  were  noted.  The 
relationship  between  variables  may  be  interpreted  as  substantial  sup  : 
for  a  cognitive  aptitude  theory  of  learning  from  instruction  (Cronbach  & 
Snow,  1977;  Witkin,  Moore,  Goodenough,  &  Cox,  1977)  and  the  media  attribute 
theory  (Salomon,  1979).    This  rationale  is  particularly  warranted  when 
considering  that  alternative  treatments  promoted  improved  performance  for 
many  low-G  learners  but  actually  diminished  the  perfovmar-e  of  many  high-G 
learners.     In  other  words,  the  treatment  that  was  mathemagenic  (gave  birth 
to  learning)  for  one  kind  of  individual  appeared  to  be  mathemathanic  (give 
death  to  learning)  for  another  kind  of  individual  and  vice  versa  (Snow, 

363 


Fluid  Ability,  Visual  Ability,  And  Visual  Placement 

16 

1977;  Snow  &  Lohman,  198A).    To  say  it  still  another  way,  different  kinds 
of  inaptitudes  showed  through  from  the  inner  environments  of  low-G  and 
high-G  learners,  depending  on  th.  nature  of  the  outer  environment. 

Results  confirmed  Hart's  (1985)  findings  of  a  general  superiority  for 
rider  females  (M»40.0  years)  when  right  screen  placement  was  utilized  to 
facilitate  simple  concept  learning.    Older  males  were  severly  dehabilitated 
under  the  right  screen  treatment  in  the  present  study,  despite  chat  males, 
as  a  whole,  performed  better  under  right  screen  placement  in  the  lower- 
order  interaction.    Niekamp  (1981)  had  noted,  by  ocular  photography,  mean 
fixations  favoring  the  ri?ht  for  a  small  group  of  subjects  who  were 
predominately  males.     In  addition,  field- independent  females  were  at  a 
distinct  performance  advantage,  as  they  had  been  in  the  earlier  Hart  study, 
confirming  that  modeling  cue  attendance  favored  only  the  highly  field- 
independent  learners  (Salomon,  1979;  Witkin.  Moore,  Oltman.  Goodenough, 
Friedman.  Owen.  &  Raskin.  1977).     Contrary  to  expectations  for  reported  sex 
differences  (Witkin  &  Goodenough.  1981).  field- independent  males  were 
dehabilitated  over  all  the  visual  treatments;  however,  the  lower  social 
orientation  of  field- inaependent  males  may  have  interacted  with  the  sex- 
role  subject  matter  to  produce  this  effect  (Goldstein  &  Blackmen.  1978; 
Witkin.  Moore,  Goodenough.  &  Cox.  1977).    Older  male  performance  was  found 
to  increase  generally  when  fluid  ability  skills  evidenced  on  the  APM  were 
called  upon  to  direct  spatial  visualization  abilities  exhibited  on  the  GEFT 
(Snow.  1980).     Thir  performance  advantage  partially  supported  the  age- 
related  differences  noted  on  the  indices  (Witkin.  Oltnan.  Raskin.  &  Karp. 
1971;  Panek.  Barrett.  Sterns.  &  Alexander.  1978;  Panek.  Funk.  &  Nelson. 
1930;  Panek  &  Stoner,  1980). 
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In  regard  to  the  APM  and  its  subtests,  right  screen  placement  was 
found  to  increase  simple  concept  acquisition  for  those  high  ability 
subjects  who  possessed  increased  pattern  addition/pattern  subtraction 
skills  (APM  subtest  I).    Individuals  performing  well  on  the  factor  are 
expected  to  successfully  ferret  out  figures  from  more  coir.»lex  forms,  to 
identify  figures  placed  in  the  periphery  of  vision,  and  to  recognize  words 
or  figures  with  portions  erased  (Dillion,  "ohlman,  &  Lohman,  1981).  When 
the  high-ability       skills  were  combined  with  the  first  subtest,  the  left 
screen  placement  interacted  for  subject  performance.    Perhaps  the  flexible 
processing  control  of       directed  the  application  of  what  may  be 
considered  a  G^  skill  in  the  solution  of  the  visual  task  (Lohman,  1979; 
Snow  &  Lohmp.n,  ]984),  since  normal  eye  scanning  patterns  are  initiated  from 
the  left  in  western  cultures  (see,  for  example,  the  eye  scanning  research 
reviewed  by  Niekamp,  1981).    In  other  words,  the  solution  of  a  visual  ta-'- 
for  concept  acquisition  required  the  intervention  of  higher-order  skills  in 
the  left  orientation,  but  tb-d  solution  was  readily  apparent  in  the  right 
screen  orientation  to  those  individuals  who  possessed  increased  levels  of 
the  pattern  addition/pattern  sul)traction  visualization  skills. 

Right  screen  placement  was  also  found  to  increase  simple  concept 
acquisition  for  those  high-ability  males  who  possessed  pattern  progression 
skills  (APM  subtest  II).    I.idividuals  exhibiting  high  performance  levels  on 
this  factor  are  expected  to  demonstrate  a  high  degree  of  success  in 
estimating  projected  movement  and  assessed  consequences,  as  well  as  in 
performing  various  mental  rotations  (Dillon,  Pohlman,  &  Lohman,  1981). 
Where  the  assembly  and  control  processing  of        interacted  with  the 
second  subtest,  males  were  at  a  perfoimance  advantage,  irrespective  of 
screen  placement.    Apparently,  tht       skill  of  pattern  progression  was 
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activated  by  right  screen  placement  in  nales  who  possessed  the  ability  at 
increased  levels;  however,  when  Lnis  same  skill  was  called  into  play  by  the 
higher-order       function,  screen  position  made  no  difference,  in  concent 
attainment.     In  other  words,  those  males  operating  at  higher-order 
strategic  processing  levels  were  able  to  obtain  salient  cues  despite  the 
visual  orientation  (Snow,  1977,  1980). 

W^ien       skills  interacted,  some  interesting  effects  were  observed. 
Males  who  possessed  high  levels  of  field  independence,  pattern 
addition/pattern  subtraction,  and  pattern  progression  were  facilitated  to 
concept  attainment  over  females  through  the  left  screen  orientation; 
however,  older  individuals  with  these  same  G^^  skills  suffered  a 
diminishment  in  performance  under  the  same  placement.    Note  that  ol.er 
males  with  only  two  of  the  three  G^  measure<5:  pattern  addition/pattern 
subtraction  and  pattern  progression,  were  dehabilitated  under  the  left 
screen  orientation.     Perhaps  some  form  of  perceptual  pretraining  has  been 
ingrained  in  high-ability  mature  individuals  who  automaMcally  activate 
^^^^^^       search  :>2  information  in  cen^'er  of  the  screen  when  viewing 
television.    Tentative  support  for  this  interpretation  is  provided  by 
another  fourth-order  interaction.     When  the  fluid  analytic  G^  skill  was 
called  upon  by  individuals  tc  diroct  the  G^  skills,  a  diminution  in 
concept  attainment  occurred  under  the  right  screen  treatment  over  central 
placement.    Thus,  as  strategic  procesring  was  called  into  play,  the  central 
placement  proved  superior  over  the  right  orientation,  indicating  at  least 
an  iriitial  preference  for  this  position.    Once  again,  the  reader  is 
reminded  this  interpretation  of  the  high-order  interactions  is  offered 
charily  until  a  better  grounded  theory  of  cognitive  aptitudes  is  developed. 
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In  summary,  the  media  attribute  (Salmon,  1979),  "asymmetry  of  tha 
screen"  (Zettl,  1973),  was  found  to  interact  with  the  cognitive  aptitudes, 
fluid  ability  and  visualization,  under  lA  conditions  on  a  simple  concept 
task.    Sex  differences  and  age  differences  were  noted.    Yet  visual 
placement  helped  many  lower  ability  learners  by  giving  them  component 
assemblies  they  cculd  not  produce  on  their  own.    On  the  other  hand,  the 
highest  aptitude  students  were  hindered  by  the  visual  treatments  because 
the  intervention  interfered  with  the  strategies  they  normally  used.  The 
importance  of  aptitude- treatment  hypotheses  and  methodology  is  thus  as 
clear  for  a  research  on  learning  strategies  in  mediated  instruction  as  it 
is  for  education  generally  (Petkovich  &  Tennyson,  198A).    While  the  method, 
organization,  and  novelty  of  instruction  are  important  factors  (Clark, 
1983,  1984a,  198Ab;  Clark  &  Salomon,  1985),  a  cognitive  aptitude  theory  of 
learning  from  instruction  will  account  for  the  involvement  of  assembly  and 
control  processes  that  marshal,  a''apt,  and  monitor  the  operation  of 
response  components  assembled  into      performance  program  for  a  given  task 
(Snow  &  Lohrop.n,  1984). 

This  exploratory  study  has  indicated  further  research  is  warranted 
with  media  attributes  when  considering  the  impact  of  different  learner 
aptitudes.    Only  52  percent  of  the  total  variability  of  visual  placement 
was  explained  by  the  variation  in  the  included  cognitive  aptitudes.  Other 
cognitive  factors  will  have  to  be  considered  for  a  better  explanation  of 
visual  placement.     Fuither,  Zettl  (1973)  had  identified  other  media  coding 
systems  within  the  frame:    main  direction  of  horizontal  and  vertical 
orientations,  attraction  of  symbol  mass,  figure-ground  relationships, 
psychological  closure,  sectors  or  directional  lines,  and  movement.  The 
relationship  between  the  processing  demands  of  these  media  attributes  and 
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th€  processing  capacity  of  the  learner  must  be  also  investigated.  Without 
question,  this  research  approach  places  the  emphasis  upon  the  single  most 
important  element  in  the  educational  process--the  human  information 
processing  system. 
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TABLE  1 

INTERCORRELATIONS  AMONG  THE  MAIN  VARIABLES 


Variables                                  ]          2         3         4         5         6  7 

.32      .26    -.02      .17    -.22  .16 

.12''  -.08    -.09    -.10  -.06 

.31      .40    -.19  .07 

.08      .11  -.06 

.03  -.02 
.21 


1.  Posttest 

2.  GEFT 

3.  APM 

4.  APM  Subtest  I 

5.  APM  Subtest  II 

6.  Sex 

7.  Age 
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TABLE  2 

SUMMARY  OF  REGRESSION  ANALYSIS 


Source  of  Variation  SS  df 


MS 


Regression  41.49  14  2.96  18.17 


I 

I 


Error  38.66  237  .16 


 R^-  .52  s  =  .40 

***P  <.001 
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TABLE  3 

ESTIMATED  REGRESSION  COEFFICIENTS 


Coefficient  SE  Standard 

Coefficient  F 


CEFT  X  Sex 


CEFT  X  Age 

-.f2/i3 
.00/^6 

.0180 
.0005 

-1.49 
.88  . 

47.87-" 

AAA 

103.11 

APM  Subtest  1      Right  Screen  Placenent 

.3187 

.0367 

1.12 

*** 

75.27 

Sex  X  Age 

.0U5 

.0076 

.3^ 

* 

3.93 

Sex  X  Right  Screen  Placeaenc 

1.4898 

.6750 

.99 

* 

4.37 

APM  X  APM  Subtest  I  X  Left  Screen  PUcement 

.0U9 

.0029 

.81 

AAA 

26.87 

APM  X  APM  Subtest  11  X  Sex 

.0053 

.0026 

.35 

A 

4.0<. 

APM  Subtest  II  X  Sex  ^  Right  Screen  Placement 

.3U5 

.lUO 

.91 

AA 

7.61 

Sex  X  Age  X  Right  Screen  Placement 

-.1238 

.0201 

-2.19 

AAA 

38.10 

CEFT  X  APM  X  Sex  X  Age 

.00013 

.00005 

.69 

AA 

6.38 

CEFT  X  APM  X  APM  Subtest  I  X  AFM  Subtest  II  X 
Right  Screen  PXacenent  ^ 

-.00020 

.COOTl 

-.78 

AAA 

4^.39 

CEFT  X  APM  Subtest  I  X  APM  Subtest  II  X  Sex  X 
Left  Screen  Placeiaent 

.0052 

.0012 

AAA 

20.05 

APM  Subtest  I  X  APM  Subtest  II  X  Sex  X  Age  X 
Left  Screen  Placement 

-  0033 

.0006 

-.89 

AAA 

27-M 

CEFT  X  APM  Subtest  I  X  APM  Subtest  U  X  Age  X 
Left  Screen  Placement 

-,00015 

.00004 

-.62 

AAA 

14,9! 

CONSTANT 

-1.^842 

*P  <  .05 
**P<  .01 
***P<  .001 
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COLLbCTION  MAPPING  IN  SCHOOL  LIBRARY  MEDIA  CENTERS 
by  May  Lein  Ho  and  David  Loertscher 


Collection  evaluation  is  a   process   that  allows  a 
school   library  nedia   specialist   to  analyze  the 
collection  and   Its   use   in  order   to  anticipate  demand 
and   shape   it  ac cording ly.     This  activity  can  help 
determine   how  the  collection  meets    the  personal  and 
academic   needs  of   ttie   library  users.     Evalua  tlon  al^o 
demonstrates   the  extent   to  which  the  materia] s   in  the 
scnool  media  collection  support   the  instructional  goals 
ot   the  curriculum  (Mancall  and  Swisher,   1983,  pp. 
257-258).      In  an  era  demanding  excellence  and,   at  the 
same   time,   accountability,   collection  evaluation  had 
been  playing  an  important   role   in  a  school  library 
media  center. 


For  many  years,   collection  size  measure  has  often 
been   the   single  most   important   way   to   evaluate  the 
collection.     Yet,   simply  measuring   collection  size  is 
not   sufficient  enough  fc   reflect   how  a  collection 
matches   the  school  &   curriculum  it   is   designed  to 
serve.     Nor  can   this  measure  clearly  indicate  the 
strengths,   weaknesses,   or   balance  of  a  collection.  The 
collection  mapping   technique  with   its  attendant 
quantitative  and  qualitative  measures   might   be  an 
answer   to   problems   like  these. 

Introduction  of   Collection  Mapping  Technique 

Tne  collection  mapping   technique  was  first 
designed   by  Dr.   David   Loertscher   (in  press)   for  guaging 
the   pot  ential  of   school  library  media   collections  to 
support   the  instructional  program  in  schools.  The 
basic   theory  behind  mapping  a   school  library  media 
collection   is   based  on  the  philosophy   that  a  collection 
in  a   school  should  serve   the  curriculum.     According  to 
Loertscher,   the  total  collection  in  a   school  library 
media   center  should   be  divided   into   three  major 
divisions   for   the  purpose  of   collection  deve  lop'jent  : 
(1)   A  basic   collection  designed   to   serve   a  wide  variety 
ot    interests  and  needs.     This   collection  provides 
breaath.      (2)   General   em'Dhasis   collections  which 
contain  materials  that  support  a  whole  course  of 
instructin   such  as   U.S.   history  and   beginning  reading. 
These   collections   provide   intermediate  depth   in  a 
collection.     (3)   Specific  emphasis   collections  which 
contain  materials   tha"   support  units  ot  instruction 
such  as   "Civil  War**  or   ^'dinosaur  s  • "     These  collections 
provide   luli  depth  and   support  as  advocated   by  the 
national   standards.     The  mechanism   oy  whi^.h  a 
collection  is  divided   into   the   three  main  collection 
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segments,   evaluated  and   t^ien  managed  has   been  titled 
collection  mapping.     Mapping  the   collections  will  tielp 
a   library  media   specialist   identify  collection 
screngths  which  can  be  comp<ired   to  the  curriculum  of 
the  school.     The  library  media   specialist  can  also 
compare  collection  size  in  topical  areas  to  a  national 
sample  ot   emphasis  collections. 


Purposes  of   the  Study 

The  purpose  of   the  present   study  was  designed  to 
field   test   collection  mapping  as  a   technique  and  to 
collect  enough  data  so  that   individual  schools  could 
compare   tbeir   collections  against  a  national  pool  of 
school   collections.     The  study  attempted   to  explore  the 
following  questions:     What  are   the  characteristics  of 
school  li^^ri^y  collections  when  they  are  maoped?  What 
types  of   collect  ions  do  school   libra ry  media 
specialists  build?     Can  the  collection  mapping 
technique  be  applied   to  a  large  number  of   schor>ls  in 
various  geographical  locations?     Can  a  national  aaca 
pool   be  developed  which  will  allow  school  libiary  media 
specialists  to  compare   their  collections  with  a 
national   sample?     And.   finally,   how  do   the  collectioas 
in  scnools  compare   to  nationally  recommended  lists  such 
as     B^-odart^s  Elementary  School  Library  Collect  ion 
(1*^84),    the  H.W.   Wilson'o  Junior   High  School  LibrTry 
C^^^alog   (1980),   aad   Senior  High  School   Library  Catalog 
(  1982)?  ^ 


Methodology  ot   the  Study 


To  explore   these   quest  ions,   questionnaires  with 
,over   lett^r^   were   sent   in  October   1984   to   120  library 
media   specialists  in  elsirentary,  junior  h'gh,   and  high 
schools   in   II   states  (Arkansas,   California,  Colorado, 
Connecticut,   Florid-,   Georgia,    Indiana,   Iowa,  Oklahoma, 
Texas,   and  Wisconsin).     Eighty   schools   returned  the 
questionnaires.     Of   these,   68  provided   sufticient  data 
and  were  judged   typical   enough   to   be   included   in  the 
study.     These   68   schools   included   37  elementary 
schools,    10  junior  high  schools,   ;*nd   21   high  schools. 

There  were   four   sections   in   the   questionnaire.  In 
Part    1,    the   library  media   specialist   was   requested  to 
provide   school  name  and  address,    the  grade   levels  in 
the  school,   and   the  number  ot   students.      In  Part   2,  the 
recjpondent   provided   the   total  number   c*:   items   In  each 
of   ttie   toliowing  segments  of   the  collection: 
reference,   000,    100,   200,   300,    398.2,   400,   500,  600, 
700,   800,   900,    biography,    fiction,   story  collection, 
easy,    periodicals,   and   professional   collection.  In 
Part    3  and   Part   4,    the   respondent   identified  general 
and  specific  emphasis  areas   if    there  were  any,  and 
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indicated  the   total  number  of   items   in  each  of  the 
areas   iUentified.     xn  the  study,   a  general  emphasis 
area  was  detined  as  a   collection  strength  in  a  library 
media  center  to  support  courses  of   instruction,  while  a 
specific  emphasis  area  supports  a  single  unit  of 
ins  t  rue t  ion • 

A  computer  program  written  iii  Basic  was  designed 
by  the  researcher  during   the  Summer  of    1984.  The 
prog^ram  generated  a  collection  map  and  a  collection 
chart   fcr  each  school   (see  Table   1  and   10  as  examples). 
A  sample  collection  map  for  a  typical   school   is  shown 
in  Table  1. 

Table   1  maps  a  collection  into   three  segments: 

(1)  The  number  of   items  per  student   in  the  total 
collection  graphed  horizontally  at   the  base  of   the  map. 

(2)  Gener<il  emphasis  area  collections  which  generally 
support  courses  of   study  mapped  vertically  on  the  left. 
In  this  case,   animals  and  folklore  &  fairytales  are 
charted.     (3)   Specific  emphasis  areas  which  generally 
support  units  of   instruction  mapped  vertically  on  the 
right.     In  this  collection  three  areas  were  identified: 
dinosaurs,   frontier  and  pioneer  life,  and  Indians  of 
North  America .     The  collection  map  shows   the  collection 
strengths  in  terms  of   size.     For  example,   there  are 
enough  materials  about   Indians   to  merit  a  superior 
rating  and  might   be  recognized  by  other  schools   in  the 
district  as  a   source  for  supplementary  materials. 

Creating  the  Collection  Map  Scales 

One  of   the  major  purposes  of   the   study  was  to 
establish  the  scales  for   the   collection  ir^p  segments, 
to  give  the  scales  reliability,   and   to   provide  a 
comparative  picture  across  many  schools.     The  national 
standard  of   40  items  per   student   was  used  as  a  guide  to 
graph  the   total  collection  at   the  base  of   the  map.  The 
labels  selected  to  denote  progress   in  building 
collections  were  as  follows:   "Mediocre,"  "Making 
Progress,"  "Good,"  "Excellent,"  and   "Exemplary."  All 
segments  of   the  collection  were  charted   in  items  per 
student.     Table  2  shows  the  five  labels  and  the  number 
ot   items  designated   tor  each  label. 
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Table  I.     COLLECT  I C3N  MAP 

School  Names 

No.  o-f  Students;  5?2 

Total  Collection:  8289 

No.  of  Total  Collection  Items  Per  Student:  13.88 

tl  o-f  items  H  o-f  items  pep 

student 

General  Emphasis  Areas: 

1.  Folklore  tc  fairytales  305  .5108 

2.  Animals  263  .4405 
Specific  Empnasis  Areas: 

3.  Dinosaurs                                       53  .0887 

4.  Frontier  t  pioneer  life               79  .1323 

5.  Indians  of  North  America  150  .2512 


Qti  ,  al 

Emphasis 

Arta5 


Specific 
Emphasis 
Areas  


EXmPlARY  7.0- 


SUPERIOft  i.20-1- 


-1-2.0  EXEMPIART 


-.25  SUPERIOR 


-I-.15  GOOD 


-I-.IO  FAIR 


KEDIKRE     HM(IN6  6000 
PROGRESS 


EXLELLENT  EXEMPLARY 


(Note:  All  nonbers  :hartid  in  itm  pir  student) 
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Table  2.     Scale  tor  the  Total  Collection  Graph 


Label 

Items/ student 

Mediocre 

1  -  7.9 

Making  progress 

8  -  15.9 

Good 

16  -  23.9 

Exce llent 

24  -  31.9 

Exempla  ry 

32  -  40 

The  creation  of   labels  and   scales  for  general  and 
specific  emphasis  areas  was  more  difficult   since  there 
was  no  standard  or   professional  Judgment   In  the 
literature   to  call   upon  for  guidance.     Four   labels  were 
chosen  as   Indicative  of   emphasis  area   size;:  ^'Falr," 
"Good,"   "Superior,"  and  "Exemplary,"     All  of  the 
emphasis  collections   In  the  participating  schools  were 
pooled  to  create  the   scales*     Since   there  we  re  two 
types  of  emphasis  areas,   e»g,,   general  and  specific, 
two  pools  were  created.     Each  of   the  emphasis  area 
collection  sizes  was  divided  by  the  number  of  students 
in  each   respective   school  and  then  pooled  for 
comparison*     The  results   revealed  a  tremendous 
.jifference  between  the  largest  and   smallest  emphasis 
collection  sizes.     Usually,   a  graphic   scale  would  be 
divided   into  equidistant   intervals   for  charting.  In 
this   case,   however,   such  an  equidistant   scale  proved 
inadequate.     Therefore,   the  emphasis   size  figures  were 
divided   into  four  quartiles  and   the  resulting  numbers 
of   items  per  student   became  the  scale   intervals.  Table 
3  shows   the  emphasis  area  scale  intervals. 
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Tablp.   3,      Emphasis  Collection  Quartiles  (Actual) 


General  Areas 

Specif  ic  Areas 

^  of  areas  indicated 

258 

204 

Mean   items  per  student 

1.11 

.19 

Largest  it   of   items  per  student 

15.62 

2.05 

Lowest  #   of   items  per  stude-^t 

.01 

.01 

1st  quartile 

.27 

.08 

2nd  quartile 

.56 

.14 

3rd  quartile 

1.13 

.23 

4th  quartile 

15.62 

2  .05 

In  order   to  generalize   the   scales  and  make  them 
practical   for  general   usage,   the   scales  were   rounded  as 
shown  in  Table  4. 

Table  4.      Founded  Emphasis  Collection  Quartiles 


La  be  i  s 

Gene  ra 1 

Areas 

Specific 

Areas 

Fair 

00  - 

.30 

00  - 

.  10 

Good 

.31  - 

.60 

.11  - 

.15 

Superior 

.61  - 

1.20 

.  16  - 

.  25 

hxeraplary 

1.21  - 

7  .00 

.26  -  2 

.00 

Note:     One   school   in   the  4th  quaTtile   had   a  general 
emphasis  collection  so   large   (15.62   items   per  student) 
that   it   was  eliminaced   when   the   quartiles   werr  ^ounded. 

Findings  of   the  study 

1.     Total  Collection   Sizes  Aero  s  Schools 

After  collections  tor  al]    the  participating 
schools   were  charted  and  mapped,   the   resulting  data 
were  analysed  across   the   schools.     As  is   shown  in  Table 
5,   the  average  collection  size   ranged  from  8,372  in 
elementary  schools   to    18,306   in  high  schools. 
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'lable  5.  Average  Collection  Size,  Average  Number  of  Items  Per  Student, 
and  Average  Emphasis  Area   Size  of   the  Participating  Schools 


Level 


of 

School s 


Elementary 
{Junior  High 
iHlgh  


37 
10 
21 


Avg.  #  of 
Students 


432 
391 
1257 


Avg.  Coll. 
Size 


8372 
12521 
18306 


#   of  Items 
Per  Student 


21.16 
16.31 
15.79 


Avg.    Size  of 
Emphasis  Areas 


2680 
2803 
357  1 


When  compared  with  the  national  recommended 
standard  ot   40   items  per   student,   the  greatest  number 
of   elementary  schools   (14   schools)   were   in  the  range  of 
16   to   23.9   items  per  student  with  the   rating  of  "Good," 
while  most  of   the  participating  junior  high  and  senior 
high  schools  were   in  the   range  of  8   to   15.9   items  per 
student  with  the   rating  of  "Making   Progress."     Table  6 
reports   the  number  ot   schools   in  each  of   the  rating 
cat  ^gor ies . 

Table  6.     The  Number  of   Collections   in  Five   Size  Categories 


Leve  1 

Making 

Mediocre 

Progress 

Good 

Excellent 

Sxempla  ry 

Total 

Elementary 

0 

10 

14 

1 1 

r\ 
I. 

37 

Junior  High 

0 

6 

2 

2 

0 

10 

High 

1 

12 

8 

0 

0 

21 

Med  i  oc  r e 

=     1  - 

7 

.9 

items/ student 

Making  Progress 

=     8  - 

15 

.9 

items/ student 

Good 

=   16  - 

23 

.9 

i  t  e  m  s  /  s  t  u  d  e  n  t 

Excel lent 

=   24  - 

31 

.9 

items/ student 

Exemplary 

=   32  - 

40 

items/ student 

II.      Emphasis   Collections  Across  Schools 


The   collection  mapping   technique   provided  a  unique 
way  of   comparing   the   strengths  of   collections  across 
schools.      Library  media   specialists   were  asked  to 
identify   emphasis   collections   which   were  defined  as 
"topical   collection   segments   larger   than  a  'typical'' 
school  might  have."     Library  media   specialists  in  the 
68   schools   identified   462   emphasis   collections,  Atter 
eliminating  duplication  and   standardizing  terminoloir^' 
tnere   were   134  discrete  emphasis  collections 
identified.     Collections   related   to   social  science, 
science,    reading  and   literature   predominated.     Table  7 
itemizes   the  emphasis  areas   identified   in   the  study. 
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Table  7.     Emphasis  Coiiections   Reported   in  Participating  Schools 


Area   Name  Frequency 

Area  Name  Frequency 

1 .    SOCIAL  SCIENCh 

1  34 

2.  SCIENCE 

112 

U«    S*    history  (general) 

20 

Animals 

States 

17 

As  t  r  o  nomy 

1  1 

Indians  of   North  America 

14 

Science  (general) 

8 

World  War   I  &  II 

Compu^.  ers 

A 

Co  un  tries 

7 

0 

Blacks 

6 

B  io 1 0£ V 

c 

J 

Holidays 

6 

Physical  sripnre 

A 

Civil  War 

5 

Insects 

■J 

lAo  u  It  c  lua  c     w  s 

3 

Presidpnt  ^ 

^    L  w  O  ^  *A  w  It  V  ^ 

4 

MpHIpaI  Qplpnpp 

■J 

Wo r Id  history 

4 

Plants 

American  government 

3 

Z  o  o  1  o  P  V 

«j  w  w  ^  w  g  jr 

Q 
J 

Economics 

1 

■J 

Bo  ta  ny 

9 

North  America 

3 

9 

Middle  ages 

2 

Ge  o 1 o  2  V 

9 

Political  science 

2 

AnthroDol  ncrv 

1 
1 

Revolutionary  War 

2 

Archeology 

1 

Social   sclencti   f  general) 

2 

Con^t^ll^^1  nn 

1 

X 

U.S.    history-20th  century 

2 

Horticulture 

1 

Colonial  America 

I  nd  u  s  t  r  V 

1 
1 

Cong  r  2  s  s 

Tnvpntion    &  ^nvpn^nFc 

1 
1 

Crime  &  criminals 

Nciural  history 

1 

Death  education 

Explo  rer s 

3.  READING 

Frontiers  &  pioneers 

Pioneer  days 

Folklor^   &  falrvtales 

Political  election 

Piptiirp  hnnk<5 

1  (\ 
1  U 

Renaissance  History 

Besinnins  reading 

Q 

Social  interaction 

BioEraDhv 

Q 

Social  problems 

Fict  ion 

9 

Sociology 

High/ low  reading 

A 
u 

Theodore  Roosevelt 

\ 

Children's  authors 

5 

T  ravel 

Award  winning  books 

4 

U.S.    geo;  raphy 

Jokes  &  riddles 

2 

U.S.    foreign  policy 

Mystery  &  detective  stories 

2 

U.S.  history-lS56- 

Science  fiction 

2 

U.S.    history   (The  West) 

Animal  stories 

Women 

Historical  Fiction 

Language  arts-junior  great  bks 

Scientific  biographies 

Young  adult  authors 
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Table   7.  Cont. 


Area   wame  f'tequ6rt<iy 

Area   wam^  Fre<lu6rt(ly 

4.  LITERATURE  41 

Poetry  12 
Mythology  6 
Snatcespeare  6 
American   literature  5 
Drama  k 
Amer  icanpoetry  2 
Amer Icanauthors  1 
Amer i can  p lay s  1 
Authorship  1 
English  literature  1 
Short   stories  1 
Theater  1 

5.  ART  20 

Art  5 
Music  4 
Crafts  2 
Drawing  2 
ART"-Western  1 
Cartoons  1 
Colors  1 
Costume  1 
Handicraft  1 
Painters  &  painting  1 
Puppets  1 

6.  HEALTH  13 

General   health  4 
Nutrition  3 
Drugs  2 
Alcohol  1 
Fitness  1 
Personal  growth  1 
Sexuality  1 

7.  LANGUAGE  12 

English  language  3 
Dictionaries  2 
Foreign   languages  2 
German  1 
Grammar  1 
Latin  1 
Linguis  tics  1 
Sign   language  1 

8.      SPORTS  12 

Sports  7 
Games  3 
.>all  games  i 
Re  creation  l 

VOCATIONAL  EDUCATION  10 

Agriculture  1 
Careers  9 

10.  HOME  ECONOMICS  7 

Cookbooks  4 
Food  2 
Home  economics  1 

11.  PROFESSIONAL  COLLECTION  5 

Prof.   coll.    (general)  4 
Teacher  aids  1 

12.  PSYCHOLOGY  5 

Except  -Unal   children  2 
Applied   psychology  1 
Childdevelopment  1 
Para-psych.   6  psych.  1 

13.  REFERENCE  2 
Reference   (general)  2 

14.  LANGUAGE  ARTS  1 
Creativewriting  1 

15.  RELIGION  1 
Religion  (general) 

16.  OTHERS  i 
Con  trove rs^al  knowledge  l 
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Table  7  is  instructive  because   it  reflects  the 
diverse  curriculum  areas   included   in  the  schools.  High 
frequency  of  collections  in  topics  such  as  U.S. 
history,   states,    Indians  of   North  America,  animals, 
folklore  &   lairy   tales,   picture  books,   poetry,  and 
astronomy  indicates   that   those  ara   the  most  common 
curriculum  areas   in   the  country  which  are  well 
supported  by  library  media  resources.     Those  areas 
might  also   be   the  collection  targets   that  current 
1 ib jary  med  ia   specialists  tend   to   build  constantly.  A 
comparison  of   topics  missing  on  the  list   but  included 
in  a   school's  curriculum  would   indicate  neglect   in  the 
collection  building  policy.      In  this   case,    the  library 
media   specialist  might  make  an  ar  .lysis  of   the  reasons 
for  collection  overlap  and  coll*"    cion  neglect.  Topics 
which  are  unique   in  one  of   the   6b   collections  give  an 
idea  of   collection  breadth.     Schools   that  have  large 
collections  of   Renaissance  history,   costume , 
horticulture,   etc.  are   important   In  resource  haring 
networks.     These  are   the  collections  which  could  be 
shared  effectively  among   the   schoolw   in  a  network. 
Resource  sharing   is  advantageous  among   schools  if 
collections  are  diverse.     To  summarize  Table  7 ,  the 
emphasis  areas  were  combined  further   into   15  central 
curricular   subjects  and  ranked.     Table  8  gives  these 
rankings . 

Table  8.  Number  of  Emphasis  Areas  Grouped  According  to 
Curriculum  Topics 


Curriculum 

Total  #   of  Areas 

it   of  Discrete 

Topics 

Mentioned 

Areas 

Social  Sci. 

134 

38 

Science 

112 

22 

Read  ing 

85 

16 

Literature 

41 

13 

Art 

20 

11 

Heal th 

13 

7 

Language 

12 

9 

Sports 

12 

4 

Voed  . 

10 

2 

Home  Ec. 

/ 

3 

Prof.  Coil- 

5 

4 

Psychology. 

5 

2 

Reference 

2 

1 

L,ang.  arts 

1 

1 

Religion 

1 

1 

Others 

1 

1 

Total 

462 

134 

ERIC 
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An  analysis  of  Table  8   reveals   that   emphasis  areas 
dominate   in   social   studies,    science,   and  collections 
dealing  with  reading  and   literature.     These  are  the 
curriculum  areas  whi-^h  will   be  served   best   by  the 
"typical"   school   library  media  collection, 

III.     Library  Media  Collection  and  National  Selection 
Lists 

In  this   study,    the  collections  of   the  68 
participating   schools  were  compared  with   the  nationally 
recognized   selection  lists:     Elementary  School  Library 
Collection,   Junior  High  School   Library  Catalog,  and 
Senior  High  School   Library  Catalog.     The  current 
editions  of   the  recommended   lists  contain  titles  which 
are   considered   representative   in  many  topical  areas, 
but   some  areas   predoniriate.     Table   ?  lists  the 
percentages  of   materials   in  each  of   the  Dewey  Decimal 
classes  • 


Table   9.      Recommended   List  Percentages 


Dewey 
Area 

Elementary 

Junior  High 

High 

Ref  . 

1.82 

3.00 

3.00 

000 

0.82 

1  .  59 

1 .  32 

100 

1  .08 

1.82 

1.81 

200 

1  .08 

1 .  10 

1.71 

300 

5.09 

10.63 

13.  74 

398.2 

6.11 

0.00 

0.00 

400 

0.80 

1.40 

1.87 

500 

10.  29 

11.55 

4.60 

600 

6.70 

9.73 

7.15 

700 

6.31 

13.65 

7.93 

800 

2.50 

1.84 

13.85 

900 

5.45 

13.45 

15.89 

6 

3.47 

10.12 

12.60 

Fic 

23.52 

15.27 

9.42 

SC 

1  13 

2.35 

2.61 

Easy 

15.87 

0.00 

0.00 

Period  . 

1  .64 

0.  ^0 

0.50 

Prof  . 

6.32 

2.00 

2.00 

Total 

100.00 

100. 00 

100.00 

Interpretation:      1.82%  of   the   titles   included   in  the 
elementary  list  are   reference  materials. 

\ote:      None   of   the   Wilson  lists  have  a  separate 
reference  or  professional   collection.     The  researchers 
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had  to  estimate  the  size  of   these  collections  through 
careful  analysis  of  each  Dewey  section. 

In  a  practical  sense,  Table  9  suggests  that  a 
library  media  specialist  might  use  the  national  list 
percentages  as  purchasing  guidelines.     A  number  of 
specialists  have  had  such  purchasing  targets,   but  such 
a  practice  has  dubious  value.     It  is,   however,  helpful 
to  compare  a  school's  collection  against  the  standard 
list  as  a  preliminary  step  in  collection  mapping.  The 
library  media  specialist  who   is  new  to  a  collection 
might  create  a  chart  like  Table   10  to  assist  in  the 
identification  of   emphasis  collections.     The  library 
media  specialist  examining  Table   10  would  examine  the 
Reference  section,   500's,   900's,   Biography,   and  Easy 
sections  first   in  order   to   identify  emphasis 
collections.     The   total   collection  chart ,   however , 
would  not  help  identify  emphasis  collections  which 
would  span  several  Dewey  classes. 

Table  IQ     Total  Collection  Chart 


School  Name: 

No.  oi  Students:  597 

Tot^i  Collection:  8289 

No.  of  Total   Collection  Items  Per  Student:  13.88 


ERLC 


Dtwe/  Area 


Recom- 
iMnded 
List '/ 


IShould 

IHavt 

I 

I  


I  I  I 

lActuall/IDiscrep-ILiKflx 
IH^ve     lancr     I  Emphasis 
I  I  lArea 

I  I  I  


Areas  That 
Ha/  Need 
Purchase 


1   1 .82  '/  1 

151  1 

259  1 

108  1 

s  1 

000 

1  0.82 '/  1 

68  1 

86  1 

18  1 

iOO 

1   1.08  '/  1 

90  1 

39  1 

-51  1 

200 

1   1,99 -/I 

90  1 

56  1 

-34  1 

300 

1   5.09  •/  1 

422  1 

4C7  ! 

-15  1 

398.2 

1  &.n  */.  i 

506  1 

305  1 

-201  1 

400 

1   0.8  '/.  1 

66  1 

110  1 

44  1 

500 

1  10.29  '/  1 

853  1 

1112  1 

259  1 

»  1 

600 

1   6.7  •/.  1 

555  1 

499  1 

-56  1 

700 

1    6.31  '/  1 

523  1 

516  1 

-7  1 

800 

1   2.5  •/.  I 

207  1 

247  1 

40  1 

900 

1   5.45  '/  1 

452  1 

981  1 

529  1 

*  1 

B 

1   3.47  •/  1 

288  1 

496  1 

208  1 

*  1 

Fic 

1  23.52  '/  1 

1950  1 

1343  1 

-607  1 

» 

sp 

1    1.13'/.  1 

94  1 

61  1 

-??  1 

Easy 

1  15.87  •/.  1 

!315  1 

1641  1 

326  1 

»  1 

Period. 

1    1 .64  '/  1 

136  1 

19  1 

-n?  1 

» 

Pro^. 

1    6.32  '/  1 

524  1 

112  1 

» 
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When  all   the  schools   in  the   study  were  compared  to 
their   respective  national   list,   some   interesting  data 
were  generated.     Table   11   compares  all   the  elementary 
collections   in  the  study  to  the  Elementary  School 
Library  Collection  percentage s. 

Table   11.     Distribution  of   Collections   -  Elementary 
School s 


De  wey 
Area 

2    in  School 
Collectto  1.3 

RppofnmpnHoH 
Lxc  ^    m  111  c  11  u  c  u 

List  % 

u  L  L xerence 
^  n  ^ 

Ref  . 

1.72 

1.82 

-0.  1 

000 

1.02 

0.82 

0.2 

100 

0.54 

1 .08 

-0.54 

200 

0.61 

1 .08 

-0.47 

300 

6.58 

5.09 

1.49 

398.  2 

3.42 

6.11 

-2.68 

400 

0.73 

0.8 

-0.07 

500 

12.91 

10.29 

2.62 

600 

6.  29 

6.7 

-0.41 

700 

5.84 

6.31 

-0.47 

800 

2.67 

2.5 

0.17 

900 

10.31 

5.45 

4.86 

B 

5.23 

3.47 

1  .76 

Fic 

21 .  20 

23.52 

-2.32 

SC 

0.62 

1.13 

-0.51 

£a  sy 

18.22 

15.87 

2.35 

Period . 

0.  28 

1 .64 

-1 .  36 

Prof  . 

1.71 

6.32 

-4.61 

Tof.i 

99.91 

100.  0 

391 
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Table   11   shows   that     more  than  62  percent  of  an 
average  elementary  school's  library  noidings  were  in  4 
categories.     These  categories  in  ranking  order  were: 
Fiction   (21.20%),   Easy  (18.22%),    500's   (12.91%),  and 
900's  (10.31%).     When  compared   to   the   recommended  list 
percentages,   an  average  elementary   school  maintained 
more  materials   in  900's,   500's,   and  easy  sections  than 
the  recommended   list.     Practically,   this  means   that  the 
national   list   is   not   as  helpful   ir   some  areas  as  it 
might   be.     For  example,   a  library  media   specialist  who 
needs  hundreds  of  easy  books   to  assist  beginning 
readers   will   find  very  little  help   in   the  list.  The 
specialist   would  also  need  additional   bibliographies  to 
develop   the  9U0's  and   500's  collections  further. 

The  Brodart   list  contained  more  materials   in  the 
areas  of   the  Professional   collection,   398.2^8  and 
Fiction   than   the   schools   in   *        study.     This  means  that 
library  media   specialists  needing   to   build  large 
collect  ions  in  these  areas  could  use   the  recommended 
list   to  good  advantage. 

Table   12   comparers  the  collections   in  the  junior 
high  schools  of   the   study  with  Junior   High  School 
Library  Cataloj^. 

Table   12.     Distribution  of   Collections  -  Junior  High 
Schools 


Dewey 

%  in  School 

Recommended 

Difference 

Area 

Collections 

List  % 

in  % 

Ref  . 

6.27 

3.0 

3.27 

000 

1.05 

1.59 

-0.54 

100 

0.81 

1.82 

-1.01 

200 

0.85 

1 .  1 

-0.25 

300 

8.46 

10.63 

-2.17 

400 

1  .  28 

i.4 

-0.12 

500 

10.75 

11.55 

-0.8 

600 

7.71 

9.73 

-2.02 

700 

8.61 

13.65 

-5.04 

800 

3.82 

1.84 

1  .98 

900 

14.54 

13.45 

1  .09 

3 

5.60 

10.  12 

-4.52 

Fic 

26.96 

15.27 

11.69 

SC 

1 .  52 

2.  35 

-0.83 

Period. 

0.35 

0.5 

-0.15 

Prof  . 

1 .  40 

2.0 

-0.60 

Total 

99.98 

100. 00 
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In   the  junior  high  school   collections,    the  top 
ranking  categories   were:   Fiction  (26*96%),  900'& 
(14.54%),   and  500's  (10.75%).     Table   12   indicates  that 
Fiction   collection   in  an  average  junior  high  school  was 
significantly  larger   than  that   suggested   in  Junior  High 
School   Library  Catalog.     The   reference  collection  was 
also   larger.     On  the  other  hand,   Junior  High  School 
Library  Catalog  provided  many  more   titles   in  700's, 
Biography,    3G0'8,   and  600's. 

Table   13  compares  the  collections  of   tlie  21  high 
schools   in  the  study  to   Senior  High  School  Library 
Ca  t alog , 

Table   13.     Distribution  of   Collections  -  High  Schools 


Dewey 

X  of  Total 

_  —  

Recommend  ed 

Difference 

Area 

Coll. 

List  7. 

in  % 

Ref  . 

5.82 

3.0 

2.82 

000 

1  .  5 

1 .  32 

0.  18 

100 

1,7 

1.81 

-0.  1  1 

200 

0.97 

1.71 

-0.7  4 

300 

12.44 

13.74 

-1.3 

400 

1  .46 

1.87 

-0.41 

500 

8.5 

4.60 

3.9 

600 

/.63 

7.15 

0.48 

700 

7.83 

7.93 

-0.  1 

800 

9.88 

13.85 

-3.97 

900 

15.99 

15.89 

0.  1 

B 

6.12 

12.  60 

-6.48 

Fic 

17  .  12 

9.42 

7.7 

SC 

1  .69 

2.61 

-0.92 

Period  . 

0.45 

0.5 

-0.05 

Prof  . 

0.89 

2.0 

-1.11 

Total 

99.99 

100.00 

In   the   high  school   collections,   more   than  one 
third   of   the   collection   in   the   average   high   school  was 
devoted   to   two  categories:      Fiction  and   900   s.  The 
third   largest   section  was   the   300's.     The   schools  had 
significantly  more  materials   in   t'iction,    500's,  and 
Reference,   while   the   recommended   Li>t   was   stronger  in 
Biography  and   800' s. 

Cone X  us  ions  and  Recommendations 

The  laain  purposes  of   this   study  were   to   test  the 
collection  mapping   technique  and   to  compare  collections 
of  materials   in   schools  with  nationally  published 
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recommended   Lists,     T\\e   research  provided  evidence  that 
collection  mapping   is  a  viable  and  effective  technique 
for  collection  analysis  and  collection  management.  It 
provides  a  different   picture  of  a  collection  rather 
than  just   size  figures.     The  mapping  procedure  is 
simple  enough  to   be  done  without   extensive  training  and 
the  resulting  graphic   representation  of  a  collection  is 
not  only  a   representation  of  collection  strengths  but 
also   charts   strength  against  a  national   sample  of 
school s . 

The  collection  mapping   technique,   as   tested  in 
this   study,   works  well   in  schools  with  student 
populations  of   500  -   1000.      Schools  with  smaller  and 
larger   student   bodies   would  need  altered   scales.  Large 
schools   should   have   fever   items  per   student   needed  for 
excellence   ratings  and   small   schools  need  more  items 
per   student . 

The   study  gave  added   evidence  of   the   breadth  and 
depth  of   school   library  media   collections   in  the 
country.     The   library  media   specialists  identified  431 
emphasis  collections   in  the   68  schools  covering  134 
distinct   topics.     These  collections   provide  sufficient 
diversity   to   support  a  network  of   resource  sharing. 
The  potential   to  share   collections  as   evidenced   in  this 
study   is  one  of   the  nation's   richest  untapped 
resources  . 

fhe   1975  national   guidelines  recommend  a  minimum 
of   20,000   items  or   40   items  per   student   for  every 
school   over  500   students.     The  guidelines  also  state 
that   library  media   specialists   in   large  schools   may  not 
wish   to  achieve   the   ration  of   40   items   per  student. 
The  schools  in  this   study  (which  are   typical  according 
to  national   statistics)   show  that   elementary  schools 
have  more   items   per   student   but   smaller  collections 
than   secondary  schools.      In  this   study,   the  average 
collection  size  for  elementary  schools  was  8,372;  for 
junior   highs,    12,521  and   18,306  for  high  schools.  More 
research  needs  to  be  done   to     establish  minimal 
collection  sizes,   not  just   for   total  collections  but 
for  collections   to  support   units   of   instruction  and 
courses   of   study.      Perhaps   size  standardo  for 
curriculum  blocks  would   be  a  direction  to  investigate. 

The   1975  guidelines  did  not   specify  guidelines  for 
building  professional   collections.     Very   few  of  the 
school s   in   this   study  had   sizeable  professional 
collections.     In  some  districts,    library  media 
specialists  noted   that   professional   materials  we  re  held 
at    the   district   level   rather   than   the   school.  In 
others,   these  collections  were  very   small  or 
non-existent . 
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The  second  aspect  of   the   study,   the   comparison  of 
coilecrions   to  nationally  published   lists,   provided  new 
'.nsights  into  the  composition  of   the  recommended  lists 
vs.   actual  collections  of  materials.     Library  media 
specialists  generally  build  collections  to  support 
supplementary  reading  aud   subject  oriented  collections 
which  serve   social   studies,   literature  and  science.  It 
is  not   surprising   that   school   library  col lections  and 
services  only  appeal   to  a   part  of   the   tocal  curriculum 
and   teaching   staff   in  a  school. 

The  study  clearly  pointed  out   that  school  library 
media  specialists   build  different  collections  than 
national   lists   recommend.     National   lists  contain 
emphasis  collections  which  have  developed  over  a  period 
of   time  which  need   re-examination  in  light  of  current 
school   curriculum.     The  orientation  of  national  lists 
toward   what   publishers   publish  is  as   troubling  as  the 
narrow  focus  of   the  collections   in  schools. 

If  school   collections  are   to   support   the  total 
curriculum,   library  media   specialists  need  to  map  theii 
collections  and   create  acquisition  targets  which  match 
their  curriculum — then  channel   their  money  into  those 
areas.     Publishers  of  national   lists  need   no  re-assess 
their  lists   regularly  and  adjust   the  scope   to  cruly 
reflect   the  curriculum  of   the  nation's  school^,     H.  W. 
Wilson,   for  example,   hasn't  yet  discovered  that 
audiovisual  media  are  as   basic  as   books   in  an 
educational  institution.     Considering   the  current 
curriculums  and   the  availability  of  computer 
technology,   perhaps   it   is   time  to   suggest   that  both 
H.W.   Wilson  and   Brodart   rethink  the  "raison  d'etra"  and 
the  methodology  of   creating  their  publications. 
Perhaps  core   titles  and  emphasis  collections  could  be 
made  available  on   floppy  disks  on  a   subscription  basis 
and/or  on-line.     Such  a  data   base  could  be  under 
continuous  revision  and  could   expand   ^ar   beyond  the 
current  efforts   toward  core  materials  only.      If  printed 
books  continue   to  go  ouu  of  print  as   has  happened  in 
the   past   few  years,   the  value  of   a  printed   list  is 
questionable . 

Perhaps   the  best  advice   to   library  media 
specialists   from  this   research  is   to   build  collections 
in  topical   segments   rather   than  just   buying  ''things." 
Nationally  published   core   lists  may   be  useful  in 
building  a   few  basic  materials   in  a   topical  area   but  to 
build  strength  and  depth  into  a   collection  require.,  a 
different  approach. 
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The  intent  of  this  research  was  to  discover  (1)  the  attitudes  of 
teachers  and  principals  toward  rural  school  libraries,  (2)  how  school 
principals  and  teachers  ccnpare  in  their  attitudes  and  (3)  wtet  do 
they  expect  in  the  way  of  services?    I  made  a  special  effort  to 
ascertain  the  adequacy  of  microcomputer  technology  in  Kansas  rural 
schools, 

'  I  identified  four  hundred  rural  and  small  schools  in  Kansas  and 
asked  them  to  participate  in  this  research.    The  schools  identified 
are  involved  with  the  Kansas  State  University  Center  for  ^ral 
Education  aivJ  Shall  Schcjols.    All  schools  had  an  enrollment  of  less 
than  600  students.   Of  the  four  hundred  schools  in  the  sam^le,  one 
hundred  and  eighty-two  schools  responded.    I  used  no  follow  up  letter 
and  this  may  account  for  the  moderate  rate  of  quest ionnaries  returned 
(45.5%). 

The  principals  of  each  school  received  three  copies  of  the  twenty 
item  questionnaire  (see  Appendix  I).    fSach  principal  cottpleted  a  copy 
and  selected  two  teachers  to  fill  out  the  ocher  two  oopies.    The  three 
ccpies  were  returned  by  the  principal.    I  collected  and  analyzed 
decographic  data  and  attitudes  toward  school  medi^.  library  services 
and  prograras.    I  also  analyzed  frequencies  for  the  demographic  data 
and  used  a  imaltivariant  analysis  of  variance  to  compare  principal  and 
teacher  groups.    The  questionnaire  consisted  of  twenty  items  with  the 
subject  ranging  from  teachers'  and  students'  attitudes  about  using  the 
library  to  instructional  development  services.   The  higher  the  score 
of  each  item,  the  iftjre  positive  the  response  of  the  principal  or  two 
teachers. 

The  principal  was  the  contact  person  in  this  study  and  he  or  she 
designated  the  two  teachers  that  were  to  respond  to  the  questionnaire. 
This  procedure  was  considered  tte  most  expedient  and  practical,  but  it 
should  be  noted  that  certain  biases  and  influences  affected  the  data 
found  since  the  principal  did  the  silecting  of  the  two  other 
respondents.    Readers  of  this  study  «hould  keep  in  mind  the  possible 
biases  inherent  in  this  procedure.        eoond  limitation  is  that  the 
attitudinal  aata  collected  Joes  jssarily  reflect  what 

conditions  really  exist  in  niral        .all  schools;  but  only  attitudes 
and  opinions  abo^^t  these  corUtions.    The  demcgraphic  data  I  collected 
aid  provide  seme  description  and  information  about  budgets,  volunnes  of 
library  books,  enrolLment,  staffing  and  education  of  the  school  nnedia 
library  personnel.    A  third  limitation  is  the  fact  that  there  was  only 
a  rnoderate  return  of  questionnaires  (45.5%)  from  *-.he  respondents,  and 
I  can  only  wonder  about  the  reasons.    Follow  up  letters  might  have 
given  a  greater  retmn  percentage  or  phone  calls  to  school  districts 
might  have  provided  more  data. 

Results  and  Discussions 

I  summarized  the  demographic  data  for  enrollment,  numb^jr  of  books 
and  budget  in  Tables  1,  2 y  and  3.    Over  half  the  schools  that 
responded  to  the  questionnaire  have  enrollments  between  '"^1  and  400 
students  (57.7%).    Only  4.9%  or  nine  schools  have  over  four  hundred 
students.    The  number  of  books  in  the  collections  vary  greatly. 
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Eleven  schools  had  collections  of  2000  or  fewer  books.  Twenty-five 
percent  had  6000  to  8000  books.    Eleven  other  schools  had  over  10,000 
books.    My  recommendation  is  a  minimum  of  15,000  to  20,000  books  for 
most  school  fnedia  libraries  to  do  an  adequate  job  supporting  the 
curriculun.    Fov  rural  or  small  schools  I  recommend  some  kind  of 
sharing  or  network  system  to  reach  the  goal  of  a  collection  of  15,000 
books.    Rural  or  small  school  budgets  varied,  with  twenty  schools 
having  a  budget  of  under  1000  dollars  and  one  school  a  62,500  dollar 
budget.    The  largest  number  of  schools  (N»29)  reported  a  budget  range 
between  2001  and  3000  dollars. 

Eighty-four  percent  of  the  schools  have  a  certified  librarian. 
The  percentage  of  time  a  librarian  spent  at  one  site  was  66.2%, 
meaning  the  librarian  spent  one-third  of  his  or  her  time  either  at 
another  school  site  serving  another  faculty  or  spent  that  time 
teaching  or  with  other  educational  activities. 

Another  study  from  the  Kansas  State  Department  of  Education 
showed  that  the  number  of  schools  served  by  one  librarian  was  as 
follows: 

In  11  districts  one  librarian  serves  4  or  more  sites. 
In  36  districts  one  librarian  serves  3  sites. 
In  106  districts  one  librarian  serves  2  sites. 
In  70  districts  two  librarians  serve  1  site. 
(Level,  1984) 

Level  (1984)  said  that  if  librarians  are  to  provide  curriculun 
support  and  instructional  development  in  each  building,  the  library 
staffing  must  be  based  on  the  number  of  teachers  in  each  building 
and  the  number  of  sites  served  rather  than  on  a  per  pupil  basis,  as 
is  the  current  practice. 

Sane  of  the  respondents  (27.9%)  did  not  know  whether  their 
librarian  had  a  master's  degree  in  the  specialized  field  of  library  . 
media.    Twenty-seven  percent  reported  that  their  school  media 
librarian  held  a  master's  degree  in  that  specialized  area,  while 
44.3%  reported  that  the  librarian  did  not  hold  a  master's  degree  in 
any  field. 

There  was  a  significant  overall  difference  between  the 
principal  group  and  the  teacher  group  with  the  aK)roximate  F=2.28 
(df=20,434),  p<.01.    The  principals  generally  had  a  higher  positive 
attitude  about  the  school  media  library  than  did  the  teachers, 
although  both  groups  were  positive.    On  two  specific  items  of  the 
twenty  item  questionnaire  there  was  also  a  significant  difference. 
The  first  significant  item  asked  the  "library  staff's  attitude 
toward  teachers"  and  the  teachers'  (N»287)  mean  score  was  4.58, 
while  the  principals'  (Nal68)  nean  score  was  4.39  with  Fa6.6 
(df=20,434),  p<.01.    The  teachers  felt  that  the  library  staff 
attitude  toward  teachers  was  better  than  the  principals  did.  In 
the  other  item  to  show  signif  ic::nc^r  the  rniestion  asked  about  the 
success  of  library  instruction:    the  principals  3.84)  felt 

a>ore  positively  that  the  school  medic:  librarians  were  doing  a  good 
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job  teaching  students  how  to  use  the  library  than  did  the  teachers 
(mean  •  3,41  w^th  a  significance  of  F-10,27  (df«20r434)r  p<.001)« 

The  chree  items  or  questions  that  dealt  with  microccraputer 
technology  generally  had  lower  mean  scores  for  both  principal  and 
teacher  groups  than  did  the  other  iterab  on  the  questionnaire  (see 
Table  4),    The  principals  v#ere  somewhat  rore  positive  than  the 
teachers  on  these  three  items.    One  item  that  both  principal  and 
teacher  groups  agreed  on  was  that  teachers  did  about  an  average  job 
(mean  =  3,33)  keeping  librarians  cdDreast  of  trends  in  curriculum. 

Conclusions 

This  research  provided  some  demographic  data  on  the  diversity 
of  library  services,  budget  and  staffing  in  the  State  of  Kansas, 
There  was  a  significant  difference  between  the  principals' 
attitudes  toward  the  school  media  center  and  that  of  the  teachers. 
As  a  group,  the  principals  were  mo-e  positive  (approximate  F^2.2S 
idf=20,434|,  p<,01).    Overall,  most  principals  and  teachers  in 
small  or  rural  schools  were  fairly  positive  about  their  school 
media  libraries.    Both  groups  were  less  positive  about  the  adequacy 
of  microcomputer  technology.   'Rie  demographic  data  showed  that 
library  staffing,  budgets  and  collection  size  varied  widely  from 
school  to  school.    Many  librarians  were  working  at  one  site  only 
66.2%  of  the  time.    In  order  for  librarians  to  work  closely  with 
faculty  and  students  in  planning,  selecting,  producing,  using  and 
evaluating  instructional  materials,  I  believe  librvians  need  to 
devote  full  time  to  one  site.    Wlien  this  practice  is  iitpractical, 
sone  sort  of  networking  or  sharing  of  staff  between  districts  may 
be  neces.<5ary  to  accoiplish  becter  library  staffing.  Positive 
attitudes  about  library  and  media  services  are  encouraging. 
However,  from  responses  to  the  questionnaire,  on-site  visits  and 
interviews  with  teachers  and  librarians  I  believe  there  is  room  for 
improvement.    Local  production  of  media  and  instructional  planning 
and  developnnent  are  services  th^t  many  librarians  do  not  have  the 
"lime  to  do  or  the  necessary  training  to  accomplish.  Principals, 
teachers  and  librarians  need  to  be  informed  about  the  potential  of 
local  production  in  the  schools.    Librarians  need  to  know  not  only 
how  to  organize,  catalog,  and  administer  the  school  media 
collection,  but  also  how  to  make  instructional  materials,  work  with 
faculty  and  students  on  learning  experiences,  integrate  resources 
and  services  into  the  total  school  program,  and  share  learning  and 
teaching  theories,  methvxjs  and  research  with  teachers  and  students. 

I  believe  that  the  school  media  library  should  be  the  fulcrum 
of  intellectual  activity  and  leamirig  for  students  and  the  catalyst 
for  innovative  learning  e)q?eriei;oes.    \  librarian  who  informs 
teachers  about  the  many  materials  and  services  the  library  has  to 
offer  can  achieve  these  goals  snd  elicit  a  positive  response  toward 
t^le  library,    I  believe  librarians  could  do  more  to  inform  patrons 
(students,  teachers,  principals,  and  parents).    Frequently  a 
library  needs  more  staffing  and  a  budget  increase  to  bring  about  a 
truly  innovative  and  comprehensive  media  library  that  does  more 
than  just  check  out  books.    I  believe  librarians  should  be  leaders 
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in  curriculum  development,  instructional  development,  local 
production  and  computer  technology.    First,  I  recormend  further 
research  on  attitudes  about  the  school  media  library  with  an 
etirphasis  on  student  and  teacher  attitudes.    Also,  I  recormend  that 
librarians  work  toward  infoming  principals,  teachers,  parents  and 
students  about  the  leadership  role  that  librarians  should  play  in 
curriculum  development,  instructional  development  and  local 
production.    Third,  librarians  themselves  may  need  to  learn  through 
inservice,  conferences,  retraining  seminars  and  formal  coursework 
about  their  role  in  local  production,  curriculum  development  and 
instructional  development. 


Table  1 


IDenographic  Data  on  Enrollment 
for  Rural  and  Small  Schools 


Pupil 
Size 


Number  of 
Schools 


Cumulative 
Percent 


Percent 
of  Total 


1 


50 

100 

200 

400 

1615 


32 
36 
59 
46 
9 


27,6% 
37,4% 
69,8% 
95.1% 
100,0% 


17,6% 
19,8% 
32,4% 
25,3% 
4,9% 


51 
101 
201 
401 


182 


401 


Table  2 


Tiber  of  Books  in  Rural  and 
anall  Schools  in  Kansas 


Size  of  Book  Nuntoer  of 

Collection  Schools  (Ngl82)  Percentage 


800  -  2000 

11 

6.04% 

2001  -  3000 

17 

9.30% 

3001  -  4000 

26 

14.30% 

4001  -  5000 

29 

15.92% 

5001  -  6000 

24 

13.20% 

6001  -  8000 

46 

25.30% 

8001  -  10,000 

18 

9.90% 

Over  10,001 

11 

6.04% 

182 

100% 

Table  3 

Budget  for  School  Media  Libraries  of 
Rura]  and  Small  Schools  of  Kansas* 

Percentage  of  Those 
Budget  Number  of  Schools     Schools  Who  Reporced  Data 


0  - 

1000 

20 

16.20% 

1001  - 

2000 

21 

17.07% 

2001  - 

3000 

29 

23.50% 

3001  - 

4000 

13 

10.50% 

4001  - 

5000 

14 

11,38% 

5001  - 

6000 

12 

9.76% 

6001  - 

7000 

6 

4.87% 

7001  - 

9500 

7 

5.69% 

62,500 

1 

.813% 

 N=123 

*59  schools  did  not  report  t-his  data. 
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Table  4 


Mean  Scores  and  Standard  Deviations  of  Principals'  (N-168) 
and  Teachers'  (N=287)  Attitudes  About  Microcotputers 
in  the  School  Media  Library 


Principals' 

bcandaro 

Teachers' 

Standard 

Variable        Mean  Sc^re 

Deviation 

Mean  Score 

Deviation 

1. 

Knowledge  of 

current  micro- 

ccftputer  soft- 

ware  tor 

subject  areas 

3.46 

1.64 

3.40 

1.91 

2. 

Library  staff 

encourages 

teachers  to 

use  micro- 

computer 

technology 

3.60 

1.79 

3.48 

2.02 

3. 

Library  staff 

helps  students 

use  microcom- 

puter software 

3.59 

1.84 

3.42 

2.04 
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Attitfjdt  Survey  of  School  Media  Libraries* 


School  District:  

Name  of  ^hooi:   

Principal: 

Teacher :   

Enrollment:   

Grades  taught: 

Total  number  of  volumes  of  library  books:   

Budget:    Library  media  budget  (excluding  textbooks  and  equipment) 

for  the  current  school  year:   

(':his  attendance  center  only) 

Do  you  have  a  certified  librarian?   

What  is  the  percentage  of  time  the  librarian  is  assigned  to  this" 

building  as  a  librarian? 
How  many  volunteers  do  you  use  in  the  library? 
Does  the  librarian  hold  a  master's  degree  in  library  science? 
Institution  granting  degree:  ^  

Other  threes:   


PLEASE  RATE  THE  FOLLOWING  ITEMS  RASED  ON  YOUR  OWN  ATTITUDE  TOWARD  AND 
EXPERIENCE  WITH  THE  LIBRARY  PROGRAM: 


o 


a. 
a 
< 

i 


4) 

u 

V 

> 
< 

Si 


4) 
U 

i) 
> 
< 


4) 

? 

u 
4) 
> 
< 

5 


1 

•3 


1«    Library  hours  and  schedule 

0 

1 

2 

3 

1  3 

2.    Procedures  and  policies  for  distributing  materials  and  equipment 

3.    Logistics  and  facilities  for  selecting,  locating  and  using  print  and  nonprlnt 
materials  In  the  library. 

^.    Overall  administration  of  library  «id  media  services  and  progrM& 

5.    Librarian's  Involvement  in  curriculum  development 

6.    Professional  atmosphere  of  the  library 

7.    Library  instruction  for  students 

8.    Students'  opinion  of  library 

9.    Teachers'  opinion  of  library 

10.    Librarian's  knowledqe  of  the  technologies  of  instruction 

11.    Use  of  mlcrocamputers  in  library  management  and  circulation  of  materials 

12.    Local  media  production  services 

13.    Integration  of  the  library  program  and  services  t»lth  the  school  prograiu 

H.    Librarian's  knowledge  about  current  microcomputer  software  available  for  subject 
areas 

15.    Instructional  development  services 

16.    Librarian's  commitment  to  professional  growth  and  leadership  roles 

17.    Librarian's  ability  to  work  with  students,  teaci  ers,  administrators  and  parents 

18.    Librarian's  dblllty  to  locate,  obtain,  select,  evaluate  and  disseminate 
instructional  materials 

19.    Librarian's  knowledge  of  learning/ teaching  theory,  methods  and  research 

20.    Library's  ability  to  provide  diverse  and  innovative  learning  experiences 

This  survey  Is  being  conducted  under  guidelines  established  by  Kansas  State  University.    By  cooperating, 
you  will  help  the  survey  administrators  find  answers  to  Important  questions;  however,  your  participation 
in  this  survey  Is  strictly  voluntary.    You  should  omit  any  questions  which  you  feel  invaoe  your 
privacy  or  which  are  otherwise  offensive  to  you.    Confidentiality  is  guaranteed. 


Hortin,  3.  A. 
in  press. 


School  media  specialists  and  their  roles  as  teachers  and  curriculum  activists.    Reading  Improvement, 


r^,^9^""^^  ^^''^^  available  from  the  author:    Dr.  3ohn  A.  Hortin,  CoUeoe  of  Education,  Kansas  State 
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INTRODUCTION 


Several  :^lters  have  discussed  the  need  for  more  research  about 
instructional  design,  and  some  have  identified  areas  particularly  in 
need  of  research.  One  general  area  designated  as  beinj^,  in  need  of 
further  research  is  the  training  and  education  of  instructional 
designers  (Durzo,  Diamond,  &  Doughty,  1979;  Silber,  1981);  several 
specific  recommendations  for  modifying  graduate  education  in 
instructional  design  have  been  proposed.  At  the  same  time,  others  have 
proposed  changes  in  graduate  education  in  educational  psychology.  One 
specific  proposal  which  has  been  made  is  the  integration  of  coursework 
in  instructional  design  into  graduate  programs  in  educational 
psychology  (Dick,  1978;  Scandura  et  al.,  1978).  Thus,  it  appears  that 
the  status  of  graduate  education  in  both  instructional  design  and 
educational  psychology  is  in  a  dynamic  phase;  a  study  examining  changes 
in  graduate  education  in  the  two  fields  would  help  to  clarify  how  the 
two  disciplines  are  changing  relative  to  each  other. 

The  usefulness  and  importance  of  individual  components  of  graduate 
education  in  instructional  design  have  been  discussed.  For  example, 
guided  field  experience  for  the  instructional  design  student  has  been 
proposed  to  be  an  essential  component  of  an  instructional  design 
curricultun  (Bass  &  Duncan,  1981-82).  Skills  in  self- evaluation  of  Job 
performance  are  necess£ry  for  professionals  delivering  services,  and 
the  need  for  better  tiaining  in  self -evaluation  skills  has  been 
discusued  (Eldridge,  19*32).  More  broadly,  the  general  development  of 
higher  cognitive  skills  as  exemplified  by  Piaget's  stages  of  concrete 
operations  and  formal  operations  has  been  proposed  as  the  goal  of 
instructional  design  education  (Silber,  1981).  Thus,  proposed 
components  of  an  instructional  design  curriculum  range  from  very 
specific  to  fairly  broad  and  comprehensive. 

Similarly,  several  persons  have  examined  the  role  of  particular 
components  of  graduate  education  in  educational  psychology.  Specific 
content  areas  such  as  human  development,  learning,  motivation,  and 
research  methodology  and  statistics  are  traditional  components  of 
graduate  education  in  educational  psychology  (Anastasi,  1979;  Sandura 
et  al.,  1978).  However,  other  areas  such  as  instructioncl  design  and 
program  evaluation  have  been  suggested  as  topics  which  should  be 
incorporated  into  the  educational  psychology  graduate  curriculum 
(Albino,  1979;  Dick,  1978;  Scandura  et  al.,  1978). 

To  date ,  however,  the  relationship  which  exists  between 
instructional  design  programs  and  educational  psychology  programs  at 
institutions  which  have  doctoral  programs  in  both  areas  has  not  been 
examined.  This  study  was  intended  to  clarify  specific  aspects  of  that 
relationship. 

The  primary  purpose  of  this  study  was  to  investigate  the 
relationships  which  exist  between  graduate  education  in  educational 
psychology  and  instructional  design.  First,  the  study  assessed  the 
extent    to    which    instructional    design    topics    are    being  studied  in 
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doctoral  programs  in  educational  psychology;  second,  the  study  also 
assessed  the  extent  to  which  doctoral  students  in  instructional  design, 
media,  and  technology  study  educational  psychology  topics  in  their 
curriculum  at  institutions  which  have  doctoral  programs  in  both  areas. 
The  study  also  determined  if  specific  curriculum  topics  in  the  two 
disciplines  had  changed  over  time,  using  five  years  ago  (1978-79  school 
year),  currently  (1983-84  school  year),  and  projections  for  five  years 
in  the  future  (1988-89)  as  the  points  in  time.  In  this  fashion,  it  was 
possible  to  determine  the  extent  to  which  the  two  programs  interact  in 
terms  of  students  studying  topics  in  the  other  area. 

Programs  which  were  examined  in  this  study  are  educational 
psychology  doctoral  programs  and  instructional  design  doctoral  programs 
at  schools  which  have  both  programs  in  their  graduate  curriculum.  With 
respect  to  educational  psychology  programs,  graduate  programs  which 
offer  the  doctorate  in  either  "educational  psychology"  or  "general 
educational  psychology"  were  included  in  this  study  (American 
Psychological  Association,  1981) .  Instructional  design,  media,  and 
technology  programs  were  identified  from  a  listing  found  in  the 
Educational  Media  Yearbook  (1983);  from  this  point,  these  programs  will 
be  referred  to  as  instructional  design  programs. 

Two  major  questions  about  the  interaction  of  graduate  education  in 
instructional  design  and  educational  psychology  were  answered  by  this 
study •  First,  what  differences  exist  between  educational  psychology 
and  instructional  design  programs  in  the  number  of  doctoral  students 
studying  specific  curriculum  topics  at  each  of  the  three  points  in  time 
which  were  examined?  Second,  can  any  trend  in  directionality  be  noted 
over  time;  that  is,  has  one  area  shifted  more  in  the  direction  of  the 
other  area?  Four  measures  of  interrelationship  between  the  two  areas, 
curriculum  topics  studied  by  doctoral  students,  recent  student 
dissertation  research,  faculty  dissertation  te.caarch,  and  contact 
between  faculty  in  the  two  programs  were  used  to  answer  these 
questions.  This  paper  will  focus  on  findings  from  curriculum  topics 
studied  and  faculty  contacts;  other  data  from  this  study  can  be  found 
elsewhere  (House,  1985). 

Additionally,  the  study  provided  a  descriptive  characterization  for 
each  type  of  graduate  program.  Information  including  how  frequently 
specific  curriculum  topics  were  studied,  recent  student  dissertation 
directions ,  faculty  dissertations ,  and  open-ended  comments  by 
responding  chairpersons  were  used  to  provide  a  brief  characterization 
of  instructional  design  and  educational  psychology  graduate  programs. 
These  findings  are  also  summarized  elsewhere  (House,  1985). 

The  results  of  t^  is  study  may  be  of  interest  :o  several  groups. 
First,  higher -level  administrators  such  as  deans  of  colleges  of 
education  are  provided  with  a  more  clear  representation  of  the 
relationship  between  doctoral  programs  in  educational  psychology  and 
instructional  design.  Second,  administrators  of  doctoral  programs  in 
instructional  design  and  educational  psychology  can  be  made  aware  of 
the  degree  of  interrelationship  between  the  two  areas,  and  how  that 
relationship  is  changing  over    time.    Third,    persons    responsible  for 
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hiring  educational  psychologists  and/or  instructional  designers  are 
provided  with  a  more  clear  characterization  of  the  types  of  experiences 
which  graduates  of  these  programs  have  been  exposed  to. 


RELATED  LITERATURK 


Characteristics  of  Instructional  Design  Graduate  Programs 

Within  the  structure  of  an  ideal  graduate  program  in  instructional 
design,  several  specific  areas  of  training  would  be  represented  and 
graduates  would  have  acquired  the  ability  to  exhibit  certain 
professional  compecencies.  Among  the  specific  areas  to  be  included  in 
an  ideal  program  would  be  educational  technology  and  media, 
instrv.ctional  psychology,  Instructional  development,  and  statistics  and 
research  methodology  (Patridge  &  Tennyson,  1978-79).  Additionally,  it 
has  been  proposed  that  graduate  students  take  courses  outside  of 
instructional  development  In  order  to  observe  how  other  disciplines 
view  the  learning  process  and  conduct  research  (Bratton,  1981).  Also, 
considerable  discussion  has  focused  upon  professional  competencies 
which  graduates  of  instructional  development  programs  should  be  able  to 
perform  (Task  Force  on  ID  Certification,  1981).  Each  of  these  areas 
will  be  examined  In  more  detail. 

A  major  component  of  the  traditional  doctoral  degree  curriculum  is 
research  (Spurr,  1970).  In  their  assessment  of  competencies  which 
would  be  Included  in  an  Ideal  program,  Patrldge  and  Tennyson  (1978-79) 
foxmd  that  research  methodology  would  a  highly  emphasized  area; 
however,  it  has  been  noted  that  graduate  students  in  instructional 
design  are  often  not  adequately  trained  to  conduct  research  (Reiser, 
1982).  Consequently,  some  graduate  programs  aie  starting  to  provide 
practice  experiences  in  research  In  the  form  of  research  practicum 
courses  (Reiser,  1982). 

Another  integral  portion  of  an  instructional  development  curriculum 
is  educational  media  and  technology.  There  are  two  generally  accepted 
definitions  for  educational  technology  (Romiszowskl,  1981).  The  first 
d'-finition  refers  to  educational  technology  as  the  use  of  hardware  or 
equipment  in  the  educational  process  while  the  second  definition 
focuses  on  the  process  of  the  scientific  development  of  learning 
experiences  through  a  knowledge  of  the  psychology  of  learning.  In 
their  study  of  components  of  graduate  programs  in  Instructional  design, 
Patridge  and  Tennyson  (1978-79)  surveyed  course  offerings  in  media  such 
as  visuals,  computers,  and  audio  and  it  would  appear  that  the  authors 
were  employing  Romiszowskl' s  (1981)  first  definition  of  educational 
technology.  Also  in  his  proposals  to  incorporate  instructional  design 
topics  into  the  educational  psychology  curriculum,  Dick  (1978) 
discusses  areas  such  as  media  selection  and  media  production, 
indicating  that  he  also  employs  a  definition  of  educational  technology 
as  being  primarily  hardware  or  equipment. 

Instructional  psychology  has  also  been  identified  as  a  major  area 
of  preparation  in  an  instructional  design  graduate  program  (Patridge  & 
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Tennyson,  1978-79).  Instructional  psychology  is  the  application  of 
findings  froL  experimental  learning  psychology  to  various  instructional 
settings  at  all  levels  of  education  (Glaser,  1982).  The  field  of 
learning  psychology  differs  from  instructic.ial  psycholog)  in  that  the 
experimental  study  of  learning  is  not  necessarily  approached  with  the 
ultimate  aim  of  being  applied  to  instrictional  practices  (Bower  & 
Hilgard,  1981);  conversely,  instructional  psychology  is  conducted  with 
the  goal  of  Improving  instruct^  .  il  methods  (Glaser). 

A  final  consideration  of  graduate  education  in  instructional  design 
is  the  development  of  professional  competencies.  A  set  of  16  basic 
competencies  has  been  proposed  (Task  lorce  on  ID  Certification,  1981). 
This  particular  list  focxises  upon  professional  activities  and  behaviors 
to  be  correctly  accomplished  by  Instructional  developers.  Other 
competencies  have  been  proposed^  includitig  appropriate  Interpersonal 
and  consulting  skills  (Bratton,  1979-80)  and  the  ability  to  interview 
clients  in  order  to  quickly  learn  basic  knowledge  in  \mfamiliar  content 
areas  (Bratton,  1981).  Thus,  a  variety  of  behavioral  and  interpersonal 
skills  are  expected  of  the  professional  instructional  developer. 

One  method  by  which  characteristics  of  present  ID  graduate  programs 
can  be  evaluated  is  by  an  assessment  of  the  content  of  those  programs. 
There  has  been  at  least  one  study  ^Ich  has  assessed  similarities  and 
differences  between  varioui'  gra.  .ate  programs  in  instructional 
development  (Patridge  &  Tennyscr.,  1978-79).  This  project  surveyed  nine 
Itraduate  programs  in  instructional  design,  documenting  program  goals 
and  characteristics y  student  characteristics,  and  faculty  preparation. 
Similarities  and  differences  between  master^  and  doctoral  programs  were 
examined.  Additionally,  representatives  of  each  graduate  program  rated 
the  order  of  emphasis  placed  upw..  a  variety  of  student  competencies  for 
their  programs;  similar  ratings  were  solicited  for  what  order  the 
competencies  would  be  ranked  in  an  ideal  graduate  program  in 
instructional  design. 

A  major  difference  found  between  masters  and  doctoral  programs  was 
program  goals.  Host  programs  placed  an  emphasis  on  the  teaching  of 
instructional  development  and/or  media  production  for  masters  students, 
while  emphasizing  a  more  traditional  study  of  research  methodology  and 
an  area  of  specialization  in  doctoral  programs  (Patridge  &  Tennyson) . 
With  respect  to  faculty  preparation,  Patridge  and  Tennyson  found  that 
most  faculty  were  trained  in  one  of  "hree  areas  (instructional 
development,  instructional  psychology,  and  visual  technology).  Faculty 
were  considerably  more  often  trained  in  visuals  than  any  other  media. 
As  well ,  more  faculty  were  trained  in  measurement  and  evaluation  than 
media  (with  the  exception  of  visuals). 

Patridge  and  Tennyson  found  that  niany  of  the  courses  taught  in 
graduate  programs  in  instructional  developmert^  fall  within  five  major 
areas:  instructional  psychology,  measurement  and  evaluation, 
instructional  development,  educational  technology,  and  management  and 
administration.  In  their  discussion  of  the  redesign  of  the  Syracuse 
University  instructional  development  graduate  program,  Doughty  and 
Dur2:o    (1981)  als  i  show  that  many  of  the  courses  in  the  curriculum  fall 
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into  the  categories  of  instructional  development,  media,  research  and 
evaluation,  and  instructional  psychology/learning.  Additionally,  they 
also  report  that  field  experiences  such  as  internships  and  practicums 
are  part  of  the  curriculum.  Patridge  and  Tennyson  report  that  five  of 
the  nine  programs  surveyed  in  their  study  offered  internship 
experiences  on  a  credit  basis  for  gr/.duate  students  in  instructional 
development. 

Patr*'''^  and  Tennyson  noted  a  wir'a  variation  across  institutions  in 
the  numb  .l'  of  courses  offered,  with  courses  in  instructional  psychology 
and  visual  technology  offered  considerably  less  often  than  courses  in 
instructicral  development.  With  respect  to  educational  media,  courses 
in  visuals  were,  most  often  taught,  followed  by  computer  courses  second; 
however,  there  was  considerable  variation  found  across  institutions  in 
the  number  of  courses  taught  in  specific  areas.  Each  program  surveyed 
by  Patridge  and  Tennyson  also  required  courses  outside  the  formal 
boundaries  of  their  own  program;  courses  in  research  methodology  and 
statistic*;  were  most  often  found  outside  the  instructional  development 
graduate  program.  Finally,  Patridge  and  Tennyson  also  found  that  there 
was  a  considerable  disparity  between  the  emphasis  placed  on  research 
competencies  and  the  number  of  research  met^-^ds  courses  olZered  within 
the  program.  More  courses  in  research  methodology  and  statistics  were 
required  than  were  actually  taught  in  instructional  development 
graduate  programs. 

In  another  study,  Silber  (1982)  reported  findings  similar  to  those 
of  Patridge  and  Tennyson.  Silber  evaluated  several  graduate  programs 
in  instructional  development  which  were  divisible  into  three 
classifications:  A)  MA  programs,  B)  residential  PhD  programs,  and  C) 
commuter  PhD  programs.  It  was  found  that  NA  programs  placed  an  emphasis 
on  practical  skills  for  Job  performance  such  as  media  production, 
project  management,  and  evaluation  skills,  findings  similar  to  those  of 
Patridge  and  Tennyson.  In  fact,  this  stu^  found  that  MA  programs  and 
residential  PhD  programs  spent  the  same  amount  of  time  on  design 
courses;  the  extra  courses  in  the  PhD  program  were  represented  by 
research  and  theory  courses*.  Also,  Silber  found  a  difference  in 
emphasis  between  commuter  and  residential  PhD  programs;  residential  PhD 
programs  emphasized  more  research  and  theory  coursework,  while  commuter 
PhD  programs  emphasized  practical  design  courses.  Lastly,  residential 
PhD  programs  spent  the  most  time  on  developing  research  and  theory 
competencies  in  fields  other  than  instructional  development  (such  as 
motivation,  perception,  developmental  psychology,  learning  psychology, 
and  cybernetics) ,  followed  by  commuter  PhD  programs  next  and  MA 
programs  last.  Resid-intial  PhD  programs  spent  approxijiately  twice  the 
amount  of  time  on  these  areas  as  did  MA  programs. 


Characteristics  of  Educational  Psvchologv  Graduate  Programs 

A  recent  examination  of  various  aspects  of  the  current  status  of 
educational  psychology  was  conducted  by  Scan^jira  et  al.  (1978).  This 
study  detailed  major  problem  areas  and  disciplinary  components  of 
educational    psychology,    curricultim    trends    in  educational  psychology 
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training  programs,  and  promising  advances  in  educational  psychology.  In 
an  effort  to  clarify  the  major  applied  activities  in  which  educational 
psychologists  conduct  research,  four  major  topics  were  Identified  by 
Scandura  et  al.;  these  four  major  areat  are:  A)  the  Identification  of 
educational  goals  (Including  needs  analysis);  B)  analysis/determination 
of  what  must  be  learn-^d  (task  analysis);  C)  delivery /designing 
Instructional  systems  (designing  Instruction,  media  selection, 
Instructional  delivery);  and  D)  readiness/evaluation  of  student 
behavior  and  course  effectiveness  (developmental  stages  and  readiness, 
evaluation  of  Instructional  programs) .  With  regard  to  graduate  training 
In  educational  psychology,  Scandura  et  al.,  suggest  that  there  Is  a 
wide  variation  In  the  quality  of  training  programs,  although  there 
seems  to  be  common  core  areas  offered;  these  specific  areas  will  be 
discussed  later.  Lastly^  a  number  of  promising  advances  in  educational 
psychology  were  discussed  by  Scandura  et  al.  (1978)  •  Areas  such  as 
cognltlv3  information  processing,  particularly  as  it  applies  to 
education,  and  artificial  intelligence  and  models  of  complex  human 
performance  and  instruction  are  cited  as  the  most  promising  research 
areas  of  the  future  for  educational  psychology. 

On  an  applied  level,  several  authors  have  discussed  various 
competencies  which  need  to  be  exhibited  by  the  educational 
psychologist.  First,  graduates  of  educational  psychology  programs 
should  be  able  to  Interact  successfully  with  professional  educators 
(Brenner,  1979;  Maggs  &  White,  1982);  this  ability  is  particularly 
Important  because  many  research  projects  arise  from  problems 
encountered  in  educational  practices  in  the  schools  (Brenner,  1979; 
Thompson  &  Lindsay,  1982)*  Also,  because  academic  openings  for 
educational  psychologists  are  few,  skills  in  testing,  evaluation  and 
assessment,  and  school  psychology  are  beneficial  (Scandura  et  al.). 

With  respect  to  the  graduate  curriculum  in  educational  psychology, 
several  authors  have  examined  the  major  areas  of  training  and  research 
represented  (Anastasl,  1979;  Brammer,  1967;  Scandura  et  al.,  1978).  In 
general  terms,  there  appears  to  be  a  relative  consensus  as  to  the  major 
components  of  graduate  training  in  educational  psychology.  First, 
traln^  g  in  research  design,  statistics,  and  educational  measurement 
and  uest  development  is  considered  to  be  an  Integral  part  of 
educi^tional  psychology  (Albino,  1980;  Anastasl,  1979);  in  fact, 
methouology  and  statistics  courses  are  Integral  parts  of  both 
educational  psychology  and  experimental  psychology  graduate  programs 
(Edwards,  1981).  Additionally,  training  in  the  area  of  applied  learning 
is  Important  (Brammer,  1967 ;  Dick,  1978) .  More  specifically, 
educational  psychology  is  oriented  toward  the  Improvement  of 
instructional  methods  through  the  utilization  of  psychological  research 
(Charles,  1980).  Last,  training  Inhuman  development  is  considered  to 
be  an  Important  part  of  an  educational  psychology  curriculum  (Anastasl; 
Dick;  Scandura  et  al.). 

There  have  been,  however,  other  proposals  regarding  the  content  of 
an  educational  psychology  curriculum.  For  example,  Brammer  (1967) 
indicates  that  educational  psychologists  should  be  active  in  relating 
the    findings    of    a    number    of    disciplines,    including  psychology. 
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sociology,  anthropology,  and  educational  technology  to  the  improvement 
of  instructional  methods;  at  least  some  training  in  basic  human 
sciences  is  necessary  (Bi-jmner,  1967).  Also,  some  education  in  the 
basic  sciences,  such  as  genetics,  is  necessary  for  conducting  research 
in  areas  such  as  intelligence  and  intelligence  testing  methods,  and 
reading  achievement  and  reading  disability  (Morton,  1974), 


Integrating  Graduate  Tnstruction  in  the  Two  Programs 

Because  of  the  relative  youth  of  instructional  design  as  a 
discipline,  individuals  working  p«?  instructional  designers  reflect  a 
variety  of  training  backgrounds  (briggs,  1982) •  Among  the  more 
traditional  disciplines  in  which  instructional  designers  have  been 
trained  are  psychology  and  educational  psychology  (Briggs,  1982). 
Because  many  persons  who  ultimately  will  function  as  instructional 
designers  will  continue  to  come  from  educational  psychology  programs, 
Dick  (1978)  has  proposed  changes  for  graduate  education  in  educational 
psychology  to  further  ;snable  graduate  students  to  acquire  instructional 
design  skills. 

Dick  has  proposed  the  integration  of  specific  courses  and 
experiences  in  instructional  design  into  the  framework  of  the 
traditional  educational  psychology  graduate  curriculxim.  For  example, 
students  would  be  taught  skills  in  needs  assessment  and  instructional 
analysis ,  testing  and  evaluation,  development  of  instructional 
strategies,  and  evaluation  of  entry  skills  and  behaviors  in  addition  to 
foundations  of  learning,  human  development,  and  statistics.  Many  of 
these  topics  would  generally  be  considered  to  be  components  of  a 
graduate  program  in  instructional  design  (Doughty  &  Durzo,  1981). 
Additionally,  Dick  proposed  that  educational  psychology  graduate 
students  should  have  internship  experiences  in  areas  such  as  teacher 
education  centers,  instructional  development  centers,  or  medical 
education  programs;  the  incorporation  of  field  experiences  into  the 
graduate  curriculum  has  been  proposed  to  be  a  desirable  experience 
(Bass  &  Duncan,  1981-82).  Thus,  Dick  has  proposed  that  the  training  of 
various  instructional  design  topics  be  fully  integrated  into  the 
educational  psychology  graduate  curriculum;  however,  he  presents  no 
data  indicating  the  extent  to  which  instructional  design  courses  and 
field  experiences  are  currently  being  taught  in  educational  psychology 
programs . 

Others  have  also  proposed  that  instructional  design  should  be 
incorporated  into  educational  psychology  programs  (Anastasi,  1979). 
Anastasi  indicates  that  instructional  design  can  be  considered  as  a 
component  of  the  larger  field  of  instructional  psychology;  the  purpose 
of  instructional  design  is  co  bridge  the  gap  which  exists  between 
experimental  learning  psychology  and  curriculum  development.  The 
result  of  research  in  instructional  psychology  is  improved  educational 
technology,  including  programmed  learning  material,  media  usage,  and 
computer-assisted  instruction.  In  other  words,  Anastasi  maintains  that 
instructional  design  should  already  exist  as  a  component  of  the 
curriculum  in  educational  psychology  while  Dick  feels  that,  because  it 
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is  currently  absent  In  many  programs,  instructional  design  should  be 
integrated  into  educational  psychology  graduate  programs. 


In  a  discussion  of  the  various  roles  performed  by  educational 
psychologists  in  the  health  sciences,  Albino  (1980)  suggests  that 
teaching  particular  skills  to  graduate  students  in  educational 
psychology  will  enhance  their  performance  in  a  health  sciences  setting. 
Briefly,  Albino  indicates  that  additional  training  for  educational 
psychology  graduate  students  is  necessary  in  the  areas  of  consultation 
skills,  program  evaluation  skills,  test  development  and  research 
design,  and  applications  of  learning  theories.  It  has  previously  been 
noted  that  much  of  the  foundation  for  training  in  program  evaluation 
skills  is  available  in  psychology  and  educational  psychology  programs 
(Perloff,  Perloff  &  Sussna,  1976;  Wortman,  Cordray  &  Reis,  1980).  With 
respect  to  applications  of  learning  theory,  Albino  emphasizes  that 
experience  in  instructional  design  should  be  acquired  by  the 
educational  psychology  graduate  student  expecting  to  function  in  a 
health  sciences  setting;  the  ability  to  evaluate  course  structures  or 
content  and  suggest  alternatives  is  important .  Additionally ,  a 
backgro.md  in  designing  instruction  for  psychomotor  and  affective 
skills  is  important.  Additionally ,  a  background  in  designing 
instruction  for  psychomotor  and  affective  skills  is  important, 
considering  the  large  amount  of  time  spent  by  health  sciences  students 
learning  clinical  skills.  Ustly,  Albino  notes  that  educational 
psychology  graduate  programs  provide  little  coursework  or  experience  in 
developing  consultation  skills.  As  mentioned  by  Bratton  (1979-80; 
1^81),  interpersonal  and  consultation  skills  are  also  important  for 
successful  performance  as  an  instructional  developed.  Patridge  and 
Tennyson  note  that  many  of  the  instructional  development  programs 
surveyed  in  their  study  placed  an  emphasis  upon  the  acquisition  of  the 
ability  to  manage  problems  and  interact  with  personnel. 


KETHPPg 

Design 

Within  educational  research,  descriptive  research  is  an  essential 
tool  for  determining  the  present  status  of  a  variety  of  educational 
practices.  In  fact,  descriptive  research  methods  are  required  to  answer 
questions  which  deal  with  current  educational  conditions  (Hopkins, 
1976),  and  can  yield  extremely  useful  results  when  properly  employed 
(Asher,  1976;  Burton,  1979).  One  of  the  major  types  of  descriptive 
research  is  the  status  study;  status  studies  are  intended  to  provide 
information  about  an  existing  set  of  conditions  or  practices  in  the 
educational  setting  (Hopkins,  1976).  Because  the  primary  objective  of 
this  project  was  to  investigate  the  relationships  which  exist  between 
graduate  education  in  educational  psychology  and  instructional  design, 
the  use  of  descriptive  research  methodology  was  appropriate. 

Subjects 

As    has     been     previously     mentioned,      program  administrators 
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(chairpersons)    of    instructional    design  and  technology  programs  at  22 
institutions  with  doctoral  programs  in  both  areas  were  surveyed, 
surveyed.    These  institutions  were: 


Florida  State  University 
Indiana  University 
Iowa  State  University 
Michigan  State  University 
New  York  University 
Pennsylvania  State  University 
Purdue  University 
Syracuse  University 
Temple  University 
University  of  Georgia 
Uni>^ersity  of  Iowa 


University  of  Virginia 
tfayne  State  University 


UnJ.versity  of  Michigan 
University  of  Minnesota 
University  of  Oklahoma 
University  of  Oregon 


University  of  Pittsburgh 


University  of  Tennessee 
University  of  Texas 


University  of  Kentucky 
University  of  Massachusetts 


Instrument  Development 

A  questionnaire  was  used  to  collect  data  on  how  frequently  graduate 
students  study  specific  topics  in  both  educational  psychology  and 
instructional  design,  and  how  frequently  those  topics  were  studied  at 
three  points  in  time:  currently  studied  (1983-84  school  year),  studied 
five  years  ago  (1978-79  school  year),  and  projected  to  be  studied  five 
years  in  the  future  (1988-89  school  year). 

This  list  of  topics  was  developed  by  examining  graduate  catalog 
course  descriptions  of  approximately  one-third  of  the  programs  which 
were  studied  in  this  project,  as  well  as  topical  headings  which 
appeared  in  instructional  design  and  educational  psychology  textbooks. 
Individ\ial  topics  were  chosen  over  courses  as  the  unit  of  measure 
because  of  the  large  differences  often  noted  between  course 
descriptions  and  actual  course  content.  Approximately  an  equal  number 
of  topics  from  instructional  design  sources  and  educational  psychology 
sources  was  identified. 

Respondents  were  asked  to  include  open-ended  comments  on  what 
trends  were  foreseen  for  their  programs  over  the  next  five  years. 
Information  was  solicited  about  the  contact  between  faculty  in 
instructional  design  and  educational  psychology  and  whether  or  not 
those  faculty  interactions  were  expected  to  increase,  decrease,  or 
remain  constant  over  the  next  five  years.  Finally,  information  was 
solicited  regarding  faculty  training  (year  and  institution  of  doctoral 
degree)  and  recent  program  graduates  (name  and  year  of  degree 
completion) . 

The  questionnaire  was  initially  pilot-tested  by  mailing  it  to  six 
departmental  chairpersons,  three  instructional  design  and  three 
educational  psychology,  who  were  not  at  institutions  included  in  the 
study.  Responses  were  received  from  three  of  these  individuals  (50%). 
All  questionnaires  were  completed  correctly  and  no  major  changes  were 
made  before  the  study  was  initiated. 
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Procedures 


The  questionnaire  was  mailed  with  a  self -addressed  post-paid  return 
envelope  to  chairperson)"  of  the  instructional  design  programs  and 
educational  psychology  programs.  Approximately  eight  weeks  after  the 
initial  mailing,  non- respondents  were  telephoned  and  subsequently  sent 
a  second  questionnaire.  At  this  point,  chairpersons  who  wove  on 
sabbatical  or  unavailable  for  other  reasons  were  identified  and  the 
questionnaires  were  sent  to  the  acting  chairperson.  As  questionnaires 
were  received,  the  data  were  entered  into  a  computer  file  for  analysis. 

Data  Analysis 

Responses  on  the  section  of  the  questionnaire  dealing  with 
curriculum  topics  were  coded  using  a  four-point  scale:  none-1,  8ome-2, 
most-3,  all-4.  Means  were  then  calculated  for  each  topic  at  each  point 
in  tirs*i  studied.  Educational  psychology  programs  were  co  ared  with 
instructional  design  programs  on  the  extent  to  which  studi  ts  studied 
various  topics  at  three  points  in  time.  Ihe  comparisons  were  made 
using  t- tests  for  each  topic  at  each  of  the  three  points  In  time. 

In  order  to  objectively  categorize  topics  as  either  Instructional 
design  or  educational  psychology  topics,  factor  analysis  was  used. 
Factor  analysis  is  a  statistical  technique  which  allows  the 
experimenter  to  examine  imderlylng  dimensions  for  a  particular  data  set 
(Kim  &  Mueller,  1978).  One  major  tise  of  factor  analysis  is 
confirmatory;  a  smaller  number  of  factors  are  identified  which  account 
for  the  covariation  in  a  given  data  set.  The  experimenter  can  specify 
the  number  of  factors  which  will  be  formed.  In  this  case,  two  factors 
were  used;  one  factor  represented  instructional  design  topics  and  the 
second  factor  consisted  of  educational  psychology  topics.  A  varimax 
rotation  was  used  to  simplify  the  factor  structure.  The  information 
derived  from  this  procedure  consists  of  each  topic  and  an  associated 
factor  loading  for  each  of  the  two  factors.  A  factor  loading  for  a 
variable  represents  the  correlation  between  that  variable  and  the 
factor  (Kleinbaum  &  Kupper,  1978).  Thus,  the  higher  positive  factor 
loading  indicates  to  vhich  factor  a  given  topic  Is  attributed. 

Topics  were  assigned  to  one  of  the  two  factors  using  the  above 
procedure.  A  topic  was  assigned  to  the  factor  for  which  there  was  a 
higher  positive  factor  loading.  After  topics  were  classified  as  beinp, 
either  instructional  design  or  educational  psychology  topics  using  the 
above  procedure,  topics  which  were  noted  to  exhibit  high  growth  were 
analyzed  to  determine  if  either  educational  psychology  programs  or 
instructional  design  programs  showed  a  disproportionate  number  of  high 
growth  topics  from  the  othei  area  (using  means  obtained  using  the 
four -point  scale  described  previously,  curriculum  topics  which 
exhibited  an  increase  of  .50  between  figures  for  the  1978-79  school 
year  and  projections  for  the  1988-89  school  year).  Chi-square  analysis 
was  used  to  test  for  significance. 
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Response  Rate 


Questionnaires  were  sent  to  44  individuals;  22  chairpersons  of 
educational  psychology  programs  and  22  chairpersons  of  instructional 
design  programs .  However ,  the  chairperson  of  the  educational 
psychology  program  at  one  i:niversicy  indicated  that ,  contrary  to 
original  information,  there  was  not  an  instructional  design  program  at 
that  institution.  Consequently,  a  final  sainple  size  of  42  was  used. 
An  overall  response  rate  of  27/42  (64.3%)  was  obtained.  For 
instructional  design  chairpersons ,  14  of  21  (66 . 7%)  completed 
questionnaires  while  13  of  21  (61.9%)  educational  psychology 
chairpersons  completed  questionnaires.  One  additional  questionnaire 
was  returned  by  an  educational  psychology  chairperson  who  indicated 
that  he  was  unable  to  understand  the  directions.  One  instructional 
design  chairperson  did  not  complete  the  first  section  of  the 
questionnaire  relating  to  student  study  of  various  curriculum  topics, 
but  did  complete  the  other  parts  of  the  questionnaire.  Also,  the 
chairperson  of  one  educational  psychology  program  responded;  however, 
he  indicated  that  his  program  was  being  terminated  due  to  a  lack  of 
graduate  students  and  he  was  unable  to  complete  the  first  section  of 
the  questionnaire.  All  other  returned  questionnaires  were  usable  and 
substantially  complete. 


Program  Compartfions 

Of  the  two  questions  investigated  x*.  this  study,  the  first  three 
involved  program  comparisons  and  are  presented  in  this  section.  First, 
changes  in  the  extent  to  which  curriculum  topics  are  studied  in  each 
program  have  changed  over  time  were  examined.  Second,  an  examination 
was  made  of  the  directionality  of  any  changes. 

The  first  question  to  be  addressed  in  this  section  is  the  extent  to 
which  curriculum  topics  studied  in  each  program  have  changed  ov-»r  time. 
Comparisons  were  made  between  programs  for  each  curriculum  topic  at 
each  of  three  points  in  time.  A  number  of  changes  were  noted  in  the 
number  of  students  studying  specific  topics  at  each  of  the  three  points 
in  time  examined.  These  figures  are  presented  in  Table  1.  The  means 
presented  in  Table  1  were  obtained  \xsing  the  four-point  scale  described 
earlier  (none-1,  some-2,  most-3,  all-4) .  of  the  72  curriculum  topics 
examined  in  this  study,  30  (42%)  showed  no  significant  differences 
between  educational  psychology  and  instructional  design  programs  at  any 
of  the  three  points  in  time  examined.  For  the  remaining  41  topics, 
several  interesting  patterns  were  noted.  For  example,  achievement 
motivation  was  reported  to  be  studied  by  significantly  more  educational 
psychology  students  than  instructional  design  students  five  years  ago 
(Table  1).  Subsequently,  the  number  of  educational  psychology  students 
studying  achievement  motivation  remained  con&tant  while  a  large  number 
of  instructional  design  students  began  to  study  the  topic  and 
eliminated  any  significant  differences  between  the  two  groups  for  the 
current  school  year  or  five  years  in  the  future.  Similarly, 
significantly  more  educational  psychology  students  studied  adolescent 
development    five    years    ago    and    during    the    current    school  year. 


418 


However,  the  number  of  educational  psychology  students  studying 
adolescent  development  is  reported  to  be  decreasing  while  the  number  of 
instructional  design  student^^  studying  it  is  increasing,  producing  no 
significant  difference  between  ::he  two  programs  for  the  1988-89  school 
year. 

Another  interesting  pattern  was  noted  for  computer-assisted 
instruction  and  interactive  video.  No  differences  were  found  between 
students  in  educational  psychology  and  instructional  design  programs 
for  the  1978-79  school  year  for  either  topic.  The  number  of 
instructional  design  students  reported  to  study  these  topics  increased 
for  the  1983-84  school  year  and  were  projected  to  increase  more  by  the 
1938-89  school  year.  The  number  of  educational  psychology  students 
reported  to  study  these  topics  also  increased,  although  at  much  slower 
rates,  producing  significant  differences  between  educational  psychology 
and  instructional  design  programs  for  the  1983-84  and  the  1988-89 
school  years. 

A  similar  trend  was  noted  for  program  evaluation  and  consultation 
skills.  Although  these  topics  were  to  be  more  frequently  studied  at 
each  point  in  time  by  instructional  design  students,  no  significant 
difference  was  found  between  programs  for  either  topic  during  the 
1978-79  school  year.  However,  significantly  more  instructional  design 
students  were  reported  to  take  each  topic  during  both  the  1978-79 
school  year  and  projected  for  the  1988-89  school  year. 

Many  topics  studied  by  significantly  larger  numbers  of 
instructional  design  students  at  each  of  the  three  points  in  time  were 
related  to  media  production:  audio/slide  production,  graphics 
production,  media  center  administration,  media  selectio*  and  \ise, 
photography  production,  telecommunications,  transparency  production, 
and  videotape/TV  production.  A  second  set  of  topics  which  were  studied 
by  significantly  more  instructional  design  students  was  related  to 
instructional  delivery  and  evaluation.  These  topics  include  curricultun 
development ,  design  of  instructi \n,  formative  evaluation, 
individailized  instruction,  instructional  evaluation,  instructional 
objectives ,  instructional  strategies,  needs  assessment,  sequencing 
instruction,  summative  evaluation,  systems  concepts,  task/content 
analysis,  and  teaching  methods. 

In  contrast,  relatively  few  topics  were  studied  by  significantly 
more  educational  psychology  students  at  each  point  in  time.  These 
topics  were  generally  related  to  human  development:  language 
development,  self -concept  determinants,  and  sex  role  development. 

In  addition  to  the  differences  between  educational  psychology  and 
instructional  design  programs  discussed  above,  a  number  of  similarities 
were  also  found.  Referring  again  to  Table  1,  it  can  be  seen  that  one 
of  the  major  similarities  found  between  the  two  programs  was  the  number 
of  students  studying  statistics  and  measurement  topics.  For  example, 
chairpersons  of  both  programs  indicated  that  a  substantial  number  of 
students  currently  studied  analysis  of  variance/covariance , 
correlation,        descriptive       statistics,        inferential  statistics, 
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standardized  tests,  and  test  reliability/validity.  Similarly,  research 
topics  such  as  experimental  research  methodology  and  research  design 
were  indicated  to  be  frequently  studied  by  students  in  both  programs. 
Topics  which  were  indicated  to  be  studied  less  often  but  at 
approximately  equal  levels  by  students  in  each  program  included  factor 
analysis,  naturalistic  research  methodology,  nonparametric  statistics, 
criterion- referenced  testing,  norm- referenced  testing,  and  standardized 
tests.  The  only  statistics  topic  for  which  a  large  difference  between 
the  two  programs  was  found  was  multiple  regression;  significantly  more 
educational  psychology  studerts  study  it  than  do  instructional  design 
students.  Additionally,  the  respondents  indicated  that  this  difference 
would  grow  even  larger  in  the  future.  Educational  psychology 
chairpersons  indicated  that  more  of  their  stxidents  would  study  multiple 
regression  in  the  future  while  instructional  design  chairpersons  felt 
that  the  same  number  of  their  students  would  study  this  topic  in  the 
future.  Finally,  a  measurement  topic,  latent  trait  theory,  was  studied 
by  relatively  few  students  in  either  program. 

A  second  question  addressed  in  this  study  was  the  issue  of 
directionality  of  change.  In  order  to  determine  whether  instructional 
design  is  incorporating  components  of  the  educational  psychology 
curriculum  or  if  educational  psychology  is  incorporating  components  of 
the  instructional  design  curriculum,  several  factors  were  examined. 
These  factors  include  curriculum  topics,  student  dissertation  research, 
faculty  dissertation  research,  and  contact  between  faculty  in  the  two 
disciplines . 

Considering  curriculum  topics,  it  will  be  recalled  that  one  of  the 
methods  used  to  characterize  instructional  design  and  educational 
psychology  programs  was  factor  analysis.  Two  factors  were  used  in  the 
factor  analysis  procedure.  It  will  be  recalled  that  topics  were 
assigned  to  one  of  the  two  disciplines  on  the  basis  of  the  factor 
analysis  procedure;  curriculum  topics  were  assigned  to  the  factor  for 
which  they  exhibited  the  highest  positive  factor  loading.  In  general, 
computer  assignment  of  the  topics  placed  them  in  the  factors  as  was 
expected.  Each  topic  was  then  examined  in  order  to  note  whether  or  not 
a  disproportionate  number  of  "instructional  design"  topics  were 
exhibiting  growth  in  educational  psychology  programs .  Similarly, 
"educational  psychology"  topics  were  examined  as  to  whether  or  not  they 
were  exhibiting  growth  in  instructional  design  programs. 

"High  growth"  was  defined  as  a  gain  of  .50  or  more  for  the  mean 
score  between  the  1978-79  school  year  and  projected  figure,*;  for  the 
1988-89  school  year  (using  the  four-point  scale  previously  described 
and  presented  in  Table  1).  Using  this  criteria  for  growth,  33%  of  the 
high  growth  topics  in  instructional  design  programs  were  topics  which 
had  been  classified  as  "educational  psychology"  topics  by  the  factor 
analysis  procedure.  In  contrast,  75%  of  the  high  growth  topics  in 
educational  psychology  programs  were  "instructional  design"  topics, 
this  being  a  significant  difference  (chi-squares-5.00,  df-1,  p<.05). 
When  the  criteria  for  defining  a  high  growth  topic  was  changed  to  a 
gain  of  .70  or  more  for  the  mean  score  between  the  1978-79  school  year 
and  projected  figures  for  the  1988-89  school    year,    25%    of    the  high 
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growth  topics  in  instructional  design  programs  were  "educational 
psychology"  topics;  75%  were  "instructional  design"  topics 
(chi-square-3.20,  df-1,  p<.08).  Although  overall  significance  was  lost 
(probably  due  to  smaller  sample  sizes  due  to  more  stringent  inclusion 
criteria) ,  the  general  trend  of  educational  psychology  programs  showing 
a  large  proportion  of  high  growth  topics  which  are  "instructional 
design**  topics  remained  consistent. 

A  second  measure  of  the  extent  to  which  educational  ps^ychology  and 
instructional  design  programs  may  be  merging  was  the  type  of  contact 
which  occurs  between  faculty  in  the  two  programs.  The  extent  of 
faculty  contacts  at  institutions  i^ere  chairpersons  in  both  programs 
responded  (N-9)  is  presented  in  Table  3.  The  most  frequent  activities 
reported  by  the  chairpersons  which  involve  contact  between  faculty  in 
the  two  programs  were  dissertation  committees  and  faculty  committees. 
Activities  which  involve  little  contact  include  team- teaching  courses, 
Joint  program  administration,  and  collaborative  research  and 
publication.  Finally,  all  chairpersons  indicated  that  these 
interactions  have  either  increased  or  remained  constant  over  the  past 
five  years.  The  respondents  were  evenly  divided,  however,  as  to  whether 
or  not  they  anticipate  those  faculty  interactions  will  increase  over 
the  next  five  years. 

These  findings  suggest  that  the  two  disciplines  are  indeed  moving 
closer  to  one  another,  with  educational  psychology  programs 
incorporating  more  topics  from  instructional  design  programs. 

Despite  the  finding  that  topics  from  the  instructional  design 
curriculum  are  being  introduced  into  educational  psychology  programs, 
the  results  of  this  study  suggest  that  a  merging  of  the  two  areas  has 
not  occurred  on  the  level  of  research  activity.  Student  dissertation 
research  was  found  to  be  conducted  in  areas  specific  to  each 
discipline . 

The  same  trend  was  true  for  cooperative  faculty  research. 
Chairpersons  of  both  programs  indicated  that  relatively  few  faculty 
engage  in  collaborative  research  or  publishing  with  faculty  from  the 
other  discipline. 

With  respect  to  other  measures  of  contact  between  faculty  in  the 
two  programs,  high  levels  of  joint  faculty  participation  on 
dissertation  committees  and  comprehensive  exam  committees  suggests 
cooperation  between  thi  two  disciplines.  Additionally,  all  of  the 
respondents  felt  that  contact  between  faculty  in  these  two  areas  had 
increased  or  remained  constant  over  the  past  five  years.  There  was  no 
clear  trend,  however,  as  to  whether  or  not  those  faculty  interactions 
would  continue  to  increase  over  the  next  five  years. 


The      primary     purpose    of    this    study    was    to    investigate  the 
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relationships  which  exist  between  graduate  education  in  educational 
psychology  and  instructional  design.  The  study  assessed  the  extent  to 
which  instructional  design  topics  were  studied  in  educational 
psychology  doctoral  programs;  this  study  also  assessed  the  extent  to 
which  doctoral  students  in  educational  technology  study  educational 
psychology  topics  in  their  curriculum  at  institutions  which  have 
doctoral  programs  in  both  areas.  The  study  also  determined  if  specific 
curriculum  topics  in  the  two  disciplines  had  changed  over  time,  using 
five  years  ago  (1978-79  school  year),  currently  (1983-84  school  year), 
and  projections  for  five  years  in  the  future  (1988-89)  as  the  points  in 
time .  Finally ,  types  of  interactions  between  faculty  in  the  two 
programs  were  examined. 

It  should  be  pointed  out  that  the  present  study  has  several 
limitations.  One  limitation  was  that  the  findings  are  not  necessarily 
generalizable  to  all  instructional  design  and  educational  psychology 
doctoral  programs.  Because  specific  types  of  programs  which  were  at 
institutions  with  programs  in  both  areas  were  studied,  the  results  may 
not  be  generalizable.  A  second  limitation  of  this  study  is  that 
projections  were  used.  Consequently,  these  figures  are  not  as  accurate 
as  would  be  the  case  with  actual  observations. 


Relationships  Between  Programs 

Two  of  the  major  questions  exrmined  on  this  study  were:  first,  are 
instructional  design  and  educational  psychology  programs  in  transition 
relative  to  one  another  and,  second,  what  are  the  directions  of  those 
changes.  The  findings  of  this  study  suggest  that  educational 
psychology  and  instructional  design  are  indeed  changing  relative  to 
each  other.  It  is  also  evident  that  those  changes  are  occurring  in  an 
uneven  fashion.  For  example,  many  of  the  topics  which  were  indicated  to 
be  rapidly  growing  in  the  educational  psychology  curriculum  were 
instructional  design  topics,  suggesting  a  merging  of  the  disciplines. 
Conversely,  however,  relatively  few  of  the  high  growth  topics  in 
instructional  design  graduate  programs  were  educational  psychology 
topics.  These  findings  suggest  that  the  two  disciplines  are  indeed 
moving  closer  co  one  another,  with  educational  psychology  programs 
incorporating  more  topics  from  instructional  design  programs. 

Despite  the  finding  that  topics  from  the  instructional  design 
curriculum  are  being  introduced  into  educational  psychology  programs, 
the  results  of  this  study  suggest  that  a  merging  of  the  two  areas  has 
not  occurred  on  the  level  of  research  activity.  Chairpersons  of  both 
programs  indicated  that  relatively  few  faculty  in  either  program  engage 
in  collaborative  research  or  publication  with  faculty  from  the  other 
discipline. 

With    respect    to    other  measures  of  contact  between  faculty  in  the 
two    programs,    high    levels    of     joint      faculty     participation  on 
dissertation    committees    and    comprehensive    exam    committees  suggests 
cooperation  between  the  two    disciplines.      Additionally,    all    of  the 
pendents    felt    that    contact    between    faculty  in  the  two  areas  had 
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increased  or  remained  constant  over  the  past  five  years.  There  was  no 
clear  trend,  however,  as  to  whether  or  not  those  faculty  interactions 
would  continue  to  increase  over  the  next  five  years. 

Because  respondents  provided  unclear  projections  as  to  whether  or 
not  these  transitions  might  continue,  it  is  possible  that  other  factors 
might  be  involved  in  the  transition  process.  For  example,  future 
curriculum  changes  might  possibly  be  more  influenced  by  institutional 
factors  rather  than  national  trends.  Thus,  the  two  programs  may 
continue  to  grow  closer  at  some  institutions  while  remaining  quite 
distinct  from  one  another  at  other  institutions. 


Future  Research 

One  topic  for  future  research  in  this  area  might  involve 
determining  qualitative  characteristics  of  student  contact  with  a  given 
subject  area.  For  example,  the  present  study  assessed  how  many 
students  studied  particular  topics  at  some  point  in  their  coursework; 
no  measure  was  made  of  the  extent  of  exposure  to  a  given  topic.  By 
obtaining  data  regarding  the  number  of  student  contact  hours  in  a  given 
area,  a  more  accurate  profile  of  major  areas  of  curricultun  emphasis 
within  a  type  of  program  can  be  derived.  Consequently,  a  study  which 
examines  topics  in  greater  detail  would  provide  an  assessment  of  the 
extent  to  which  topics  are  studied  rather  than  an  assessment  of  how 
many  students  are  exposed  to  a  given  topic  as  was  the  case  in  this 
study. 

A  second  project  that  would  provide  additional  information  would  be 
a  study  of  specific  topics  in  a  graduate  curriculum.  Such  a  project 
could  be  done  using  methods  similar  to  this  study.  Rather  than 
sampling  a  large  number  of  topics  as  was  done  in  this  study,  a  small 
content  area  could  be  examined.  For  example,  rather  than  identifying 
computer- as  sis  ted  instruction  as  one  of  many  topics,  the  research  could 
focus  on  CAT  as  the  only  topic  to  be  studied.  This  topic  could  then  be 
divided  into  smaller  topics  such  as  artificial  intelligence,  expert 
systems,  evaluation,  simulations,  and  games.  In  this  fashion,  it  would 
be  possible  to  identify  programs  which  are  providing  doctoral  students 
with  exposure  to  the  most  current  topics.  Open-ended  responses  should 
provide  insight  into  the  reasons  for  program  differences;  in  the  CAI 
example,  possible  reasons  might  include  students  with  better  computer 
science  backgrounds ,  hardware  availability,  or  other  reasons .  A 
project  of  this  type  would  allow  the  researcher  to  study  trends  in 
smaller  components  of  specific  graduate  programs  in  a  detailed  manner. 

Another  future  research  project  would  consist  of  replicating  this 
study  during  the  1988-89  academic  year.  Responses  given  at  that  time 
could  be  compared  to  the  findings  reported  in  this  study.  Open-ended 
responses  could  be  requested  to  investigate  possible  reasons  for  the 
differences  between  projections  in  the  current  study  and  findings  for 
the  future  follow-up  study.  Such  a  follow-up  study  would  allow  the 
investigator  to  determine  whether  the  instructional  design  topics  that 
are    being    integrated    into  the  educational  psychology  curriculum  will 
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lead  to  future  dissertation  research  in  those  areas.  Also,  it  would  be 
possible  to  note  if  collaborative  research  and  publication  by  faculty 
in  the  two  programs  were  increasing. 

Another  approach  to  examining  the  trends  noted  in  this  study  would 
be  to  conduct  a  future  study  using  the  Delphi  technique.  Briefly,  the 
Delphi  technique  is  a  procedure  used  for  forecasting  trends.  By 
distributing  a  series  of  questionnaires  to  experts  ij  a  particular 
field,  responses  can  be  modified  by  each  individual  after  having 
evaluated  the  responses  of  the  group  for  the  previous  round  of 
questionnaires  (Amidon,  1977).  Opinions  can  be  reviewed  throughout  the 
process  and ,  by  the  final  questionnaire ,  concensus  and  minority 
opinions  can  be  developed.  Such  a  procedure  might  be  used  to  allow 
chairpersons  of  instructional  design  and  educational  psychology 
programs  to  amplify  on  what  trends  they  anticipate  for  their  programs. 
Opinions  could  be  developed  for  the  future  of  each  discipline 
individually  as  well  as  for  future  interactions  between  the  two 
disciplines. 


Ihe  results  of  this  study  indicate  that  instructional  design 
programs  and  educational  psychology  programs  are  in  transition. 
However,  these  changes  appear  to  be  occurring  at  an  instructional 
level.  Topics  from  each  program  are  being  introduced  into  course 
content  iu  the  other  discipline.  Merging  at  the  level  of  dissertation 
research  and  collaborative  faculty  research,  however,  has  not  taken 
place. 

There  was  no  clear  indication  as  to  whether  or  not  these  trends 
would  continue.  Future  research  can  determine  if  the  two  programs  will 
continue  to  move  toward  each  other  and,  if  that  is  the  case,  in  what 
respects  they  might  merge. 
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Table  1 


Comparisons  Between  Groups,  Instructional  Design  (ID)  and 
Educational  Psychology  (EP) ,  At  Three  Points  In  Time 


Topic  Academic       ID         SD         EP  SD 

Year  Mean  Mean 


Achievement 

1978- 

79 

1. 

89 

.60 

2. 

82 

.87 

.0145 

Motivation 

1983- 

-84 

2. 

30 

.82 

2. 

83 

.83 

NS 

X7  OO- 

O  7 

0 

^  ■ 

/  J 

SQ 

0 

0  J 

.  0  J 

Mb 

Adolescent 

1978- 

•79 

1. 

55 

.69 

2. 

91 

.70 

.0002 

Development 

1983- 

-84 

1 

83 

.94 

2. 

67 

.78 

.0270 

•  oy 

o 

L 

O 

Z  . 

Do 

.  90 

NS 

Adult 

1978- 

•79 

2 

17 

.83 

2. 

27 

.79 

NS 

Development 

1983- 

•84 

2 

54 

.88 

2. 

64 

.81 

NS 

1  Qftft. 
X700- 

.  RQ 

•  0-7 

O 
L 

00 

0 

Z  , 

.  /O 

NS 

Affective 

1978- 

•79 

2 

20 

.42 

2. 

18 

.75 

NS 

Measurement 

1983- 

■84 

2 

8C 

.42 

2. 

25 

.75 

NS 

1  Qftft 
X700- 

■  07 

J 

1  fk 

7  A 

0 

Z  . 

.  07 

.0419 

ANOVA/ANCOVA 

1978- 

■79 

3 

•.'3 

.90 

3. 

64 

.50 

NS 

1983- 

■84 

3 

75 

.87 

3. 

75 

.45 

NS 

1  Qfifi 

^ 

DM- 

00 

.  7/ 

/  J 

.  43 

NS 

Aptitude 

1978- 

■79 

2 

60 

.97 

2 . 

S2 

.75 

NS 

Tests 

1983- 

■84 

3 

09 

.83 

2. 

92 

.79 

NS 

1988- 

■89 

3 

30 

.67 

2. 

83 

.94 

NS 

Attribution 

1978- 

■79 

1 

88 

.83 

2. 

09 

.54 

NS 

Theory 

1983- 

■84 

2 

?3 

.50 

2. 

75 

.45 

NS 

1988- 

■89 

2 

38 

52 

2. 

75 

.62 

NS 

Audio/Slide 

197C- 

■79 

3 

31 

.75 

1 

27 

.47 

.0001 

Production 

1383- 

-84 

08 

.86 

1 

42 

.51 

.0001 

1988- 

■89 

3 

00 

1.04 

1. 

58 

.67 

.0007 

Classroom 

1978- 

•79 

1 

90 

.57 

2. 

36 

.50 

NS 

Management 

1983- 

■84 

2 

00 

.63 

2. 

50 

.52 

NS 

1988- 

•89 

2 

00 

.67 

2 

50 

.52 

NS 

Cognitive 

1978- 

■79 

2 

32 

.75 

3 

36 

.67 

NS 

Development 

1983- 

■84 

3 

09 

.83 

3 

67 

.65 

NS 

1988- 

■89 

3 

.36 

.81 

3 

67 

.65 

NS 
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Table      1  (Continued) 


Topic 

Academic 

ID 

SD 

EP 

SD 

P 

Year 

Mean 

.  

Mean 

-  •  •  0 

Computer- 

1978- 

79 

2 

23 

.93 

1. 

82 

.87 

NS 

1983- 

84 

3 

23 

2. 

42 

.  00/y 

Instruction 

1988- 

X  7  o  o 

89 

.28 

9 

R'^ 

.83 

.0002 

Computer  Data 

1978- 

79 

2 

42 

.79 

2. 

64 

.81 

NS 

A.T\0  1        ^  c 

1983- 

84 

3. 

00 

.  Jo 

3. 

50 

.  J I 

1988- 

89 

O  7 

'^'^ 

.78 

■> 

/  J 

.45 

NS 

Consultation 

1978- 

79 

2 

33 

1.15 

1 

82 

.40 

NS 

cv-f  11c 

1983- 

84 

2 

92 

7Q 
•  ly 

2. 

00 

X  7  O  O 

89 

O  7 

A.  J 

.75 

c 

'^'^ 

.65 

.0043 

Correlation 

1978- 

79 

3 

60 

.52 

3 

55 

.52 

NS 

1983- 

84 

3 

55 

.  07 

3 

75 

A  ^ 

MO 

1  QRR  - 

■> 

.50 

0 

/  J 

.45 

NS 

Creativity 

1978- 

79 

2 

30 

.95 

2 

27 

.47 

NS 

1983- 

84 

2 

27 

on 
.  7U 

2 

33 

NS 

1  Qfifi 

07 

O 
/ 

.92 

LI 

.72 

NS 

Criterion- 

1978- 

7Q 

3 

.45 

.82 

2 

45 

.69 

.0057 

Referenced 

1^83- 

84 

3 

.50 

.0/ 

2 

92 

.79 

NS 

Testing 

1  Qfifi 
1700  - 

07 

.  Do 

.67 

Uo 

.90 

NS 

Curriculum 

1978- 

79 

3 

.15 

.99 

2 

09 

.70 

.0068 

Development 

1983- 

84 

3 

.15 

00 
.  yy 

2 

08 

.67 

.  0045 

1  QUA 

RQ 

.  /3 

.97 

AD 

.  Uo 

.67 

.0023 

Descriptive 

1978- 

79 

3 

.55 

.82 

3 

.73 

.65 

NS 

k>  uauxs  uxcs 

1983- 

84 

3 

.42 

on 

.  7U 

3 

.83 

NS 

1988- 

89 

3 

.55 

.82 

3 

.83 

.39 

NS 

Design  Of 

1978- 

79 

3 

.85 

.38 

1 

91 

.54 

.0001 

Instruction 

1983- 

84 

4 

.00 

.00 

2 

.25 

.62 

.0001 

1988- 

89 

4 

.00 

.00 

2 

.25 

.62 

.0001 

Early  School 

1978- 

79 

1 

.73 

.65 

2 

.18 

.40 

NS 

Experiences 

1983- 

84 

1 

.75 

.45 

2 

.25 

.62 

.0345 

1988 

89 

1 

.64 

.50 

2 

.33 

.49 

.0030 

Experimental 

1978- 

79 

3 

.50 

.67 

3 

.82 

.4" 

NS 

Research 

1983- 

84 

3 

.75 

.62 

3 

.83 

.39 

NS 

Methodology 

1988- 

89 

3 

.75 

.62 

3 

.92 

.29 

NS 
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Table      1  (Continued) 


Topic 

Academic 
Year 

ID 
Mean 

SD 

EP 
Mean 

SD 

P 

Exploratory 

17/0 

7Q 
-  /7 

2 

•  dQ 

.85 

2 

.  64 

.92 

NS 

.  o2 

ft7 
0  / 

3 

.  00 

.  95 

NS 

1988 

-89 

2 

.90 

.99 

3 

.08 

.90 

NS 

Factor 

ly/O' 

"TO 
•/7 

2 

.  33 

1 

.00 

2 

.36 

.67 

NS 

An  A 1  v<;  i  4 

OA 

2 

.  50 

fl  ^ 

.  OJ 

2 

.  50 

OA 

.  80 

NS 

1988 

-89 

2 

.80 

.92 

2 

.67 

.89 

NS 

Film 

70 
"  /7 

2 

AA 
.  UO 

.89 

1 

.18 

.40 

.0153 

1  Oft") 

fl/< 
>0<f 

1 

.  o3 

1 
1 

U3 

1 

33 

.49 

NS 

1988- 

-89 

1 

.82 

1 

17 

1 

25 

.45 

NS 

Formative 

1  0711 
i7  /O' 

70 
/7 

.  73 

65 

2 

09 

.70 

.0001 

Evaluation 

l70  J  - 

•o*f 

.  0/ 

OD 

2 

25 

.0001 

1988- 

-89 

3 

.73 

65 

2 

33 

.78 

.0001 

Graphics 

1  0711 
17  /  O  • 

70 
■  /  7 

Q 

.  UU 

91 

1 

36 

.67 

.0001 

Production 

X70  J  ' 

.  /  / 

1 
X 

m 

1 

A  0 

42 

A7 
.  0  / 

.  UUUi 

1988- 

-89 

2 

.64 

1 

03 

1 

42 

.67 

.0001 

Individual 

i7ft 

70 
■  /7 

.  33 

71 

2 

91 

.83 

NS 

V     X  X  w  X  w  1 w  0 

A  Jo  J' 

ft  A 

A  A 

/u 

3 

AO 

08 

OA 
.  7U 

NS 

1988- 

-89 

3 

.44 

73 

3 

08 

.90 

NS 

Individualized 

1  Q7Q 

"TO 

■■79 

3 

A  C 

.45 

.69 

2 

27 

.47 

.0001 

Tn<5  t'lTJp  t"  i  on 

1  Qfi 
l70  J 

OA 

3 

C  A 

.  50 

A7 
0  / 

2 

50 

.  DZ 

.  0003 

1988- 

-89 

3 

.67 

65 

2 

.58 

.67 

.0006 

Inferential 

19/0- 

■79 

3 

C  A 

.50 

90 

3 

.73 

.65 

NS 

1983' 

-84 

3 

.69 

03 

3 

.75 

.  62 

NS 

l700 ' 

OQ 
•0? 

3 

CO 

.  30 

67 

3 

.75 

.62 

NS 

Information 

1978- 

■79 

2 

.25 

75 

2 

.45 

.69 

NS 

Processing 

1983- 

-84 

2 

.83 

72 

3 

00 

.74 

NS 

1S88- 

■89 

3 

.00 

77 

3 

08 

.79 

NS 

Instructional 

1978- 

■79 

3 

.58 

67 

2 

36 

.81 

.0007 

Evaluation 

1983- 

■84 

3 

85 

38 

2 

50 

.80 

.0001 

1988- 

■89 

3 

83 

39 

2 

75 

.75 

.00u4 

Instructional 

1978- 

79 

4 

00 

00 

2. 

45 

.82 

.0001 

Objectives 

1983- 

84 

4 

00 

2 

58 

.90 

.0004 

1988- 

89 

4 

00 

00 

2. 

75 

.87 

.0001 

ERIC 
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Table      1  (Continued) 


Topic 

Academic 
Year 

ID 
Mean 

SD 

EP 
Mean 

SD 

P 

Instructional 

1978- 

■  79 

.67 

z 

HQ 

U7 

.54 

.0001 

Strategies 

X  7  O  ^ 

R3 

.  39 

ZD 

nnm 

■  \J\J\J  X 

1988- 

-89 

3 

91 

.30 

2 

50 

.67 

.0015 

Instructional 

1978- 

•  79 

■J 

49 

.90 

0 

OQ 

U7 

.83 

.0002 

Theory 

1983- 

•84 

3 

62 

65 

0 

7R 
■  /  o 

nnno 
.  uuuz 

1988- 

89 

3 

55 

.69 

2 

83 

.94 

NS 

Interactive 

.7Q 

1 

X 

.45 

1 
1 

07 

.47 

NS 

Video 

1983- 

X  7  O  V 

84 

2 

00 

43 

1 

X 

■  i. 

1988- 

89 

2 

82 

.60 

2 

00 

.74 

.0087 

Intrinsic/ 

1  97R. 

.79 

0 

£. 

1 

.04 

.81 

NS 

Extrinsic 

1983- 

X  7  O  V 

84 

0 

fi7 

1 

07 

on 

fin 

Motivation 

1988- 

89 

2 

92 

1 

.08 

2 

92 

.67 

NS 

Language 

1978- 

•79 

1 

73 

.90 

0 

.52 

.0317 

Development 

1983- 

84 

1 

83 

.83 

0 

51 

■  «/  X 

0147 

■  \J  XH'  / 

1988- 

89 

1 

91 

.83 

2 

58 

.51 

.0279 

Latent  Trait 

1978- 

-89 

1 

45 

.69 

1 

X 

64 

.67 

NS 

Theory 

1983- 

*84 

1 

58 

.67 

1 

92 

.  51 

NS 

1988- 

*S9 

1 

64 

.67 

2 

00 

.51 

NS 

Media  Center 

1978- 

•79 

2 

58 

.90 

1 

X 

00 

.00 

.0001 

Administration 

1983- 

-84 

2 

.38 

.87 

1 

X 

00 

\J\J 

.00 

0001 

■  www  X 

1988- 

•89 

2 

.33 

.89 

1 

08 

.29 

.0004 

Media 

1978- 

-79 

3 

69 

.63 

1 

X 

JO 

.50 

.0001 

Selection  and 

1983- 

-84 

6Q 

63 

1 

X 

49 

•  7 

0001 

■  WW  w  X 

Use 

X  7  O  O 

'X 

7*^ 

.65 

1 

.  3U 

.52 

.0001 

Memory/ 

1978- 

79 

2 

.92 

1 

.08 

2 

.91 

.83 

NS 

Forgetting 

1983- 

-84 

3 

.17 

.83 

3 

.17 

.83 

NS 

1988- 

-89 

3 

.27 

.90 

3 

.17 

.83 

NS 

Meta-analysis 

1978 

■79 

1 

.42 

.51 

1 

.91 

.94 

NS 

1983 

-84 

2 

.17 

.58 

2 

.17 

.83 

NS 

1988 

-89 

2 

.27 

.65 

2 

.75 

.75 

NS 

Multiple 

1978- 

-79 

2 

.27 

.90 

3 

.00 

.77 

NS 

Regression 

1983 

-84 

2 

.58 

.90 

3 

.25 

.62 

.0464 

1988 

-89 

2 

.55 

.93 

3 

.42 

.51 

.0107 
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T^ible      1  (Continued) 


Topic 

Academic 

ID 

SD 

EP 

SD 

P 

Year 

Mean 



Mean 





Naturalistic 

1978- 

■79 

1 

.64 

.50 

2 

.36 

.81 

.0199 

Research 

1983- 

-84 

2 

.67 

78 

2 

.42 

•  O  / 

Methodology 

1988- 

■89 

2 

.91 

.94 

2 

50 

.90 

NS 

Needs 

1978- 

■79 

2 

.83 

1 

.03 

2 

.09 

.30 

.0328 

Assessment 

1983- 

-84 

3 

.50 

.67 

2 

00 

1988- 

■89 

3 

75 

.45 

2 

00 

•  \J\J 

.43 

.0001 

Nonparametric 

1978- 

79 

2 

.50 

1 

.08 

2 

.55 

.82 

NS 

Statistics 

1983- 

84 

2 

.73 

.90 

2 

.83 

no 

1988- 

89 

2 

.  91 

.94 

2 

.90 

NS 

Norm-Referenced 

1978- 

79 

3 

.18 

.87 

2 

.82 

.75 

NS 

Testing 

1983- 

84 

3 

.17 

.83 

3 

.00 

.  OJ 

no 

1988- 

89 

3 

18 

.87 

2 

92 

.79 

NS 

Peer 

1978- 

79 

1 

.50 

.53 

2 

.45 

.52 

.0005 

Relationships 

1983- 

84 

2 

.00 

.77 

2 

.50 

S2 

no 

1988- 

89 

2 

10 

.74 

0 

so 

.52 

NS 

Personality 

1978- 

79 

1 

.91 

.94 

2 

.55 

.52 

NS 

Deve lopment 

1983- 

84 

1 

92 

.  90 

2 

.67 

.  UX7U 

1988- 

89 

2 

08 

i 

.08 

2 

67 

.49 

NS 

Photography 

1978- 

79 

2 

85 

.90 

1 

00 

.00 

.0001 

Production 

198? 

84 

2 

69 

.95 

1 

08 

.  29 

1988- 

89 

2 

67 

1 

.07 

1 

17 

.39 

.0005 

Principles 

1978- 

79 

3 

75 

.45 

3 

36 

.81 

NS 

of  Learning 

1983- 

84 

3 

92 

.29 

3 

58 

.67 

NS 

1988- 

89 

3 

91 

.30 

J 

67 

.65 

NS 

Problem- 

1978- 

79 

2 

91 

.94 

2 

.55 

.69 

NS 

Solving  Skills 

1983- 

84 

3 

18 

.75 

2 

.92 

.67 

NS 

1988- 

89 

3 

30 

.67 

2 

92 

.67 

NS 

Program 

r- . 

2 

.67 

.98 

O 

4U 

.09 

.54 

NS 

Evaluation 

1983- 

84 

3 

.08 

.79 

2 

.50 

.52 

.0448 

1981- 

89 

3 

36 

.67 

2 

.75 

.62 

.0337 

Programmed 

1978- 

79 

2 

75 

.75 

2 

.18 

.40 

.0375 

Instruction 

1983- 

84 

2 

83 

.72 

1 

92 

,67 

.0038 

1988- 

89 

2 

55 

1 

.04 

1 

92 

.67 

NS 
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Table      1  (Continued) 


Topic 

Academic 

ID 

SD 

EP 

SD 

P 

Year 

Mean 



Mean 





Research 

1978- 

79 

3 

83 

.39 

3 

55 

.69 

NS 

Design 

1983- 

84 

■  3 

92 

.29 

3 

75 

45 

X  7  O  O 

89 

■» 

Q1 

yx 

.30 

•J 

.39 

NS 

Roles  of 

1978- 

79 

2 

42 

1 

.08 

3 

18 

.87 

Heredity/ 

1983- 

84 

2 

42 

1 

.08 

3 

08 

90 

11  o 

Environment 

X700 

ftQ 
oy 

Z 

1 

.13 

J 

Uo 

.90 

NS 

Self -Concept 

1978- 

79 

1 

73 

65 

2 

45 

.  yjyjoo 

Determinants 

1983- 

84 

1 

73 

.65 

2 

50 

52 

0047 

X700 

ftQ 

1 
X 

/  u 

.67 

z 

DU 

.52 

.0052 

Scquenc ing 

1978- 

79 

3 

42 

.67 

1 

91 

0001 

Iiis  true  t  ion 

1983- 

84 

3 

67 

.65 

1 

92 

99 

onm 

X700  - 

ftQ 

oy 

•J 

.67 

1 
1 

.29 

.0001 

Sex  Role 

1978- 

79 

i 

42 

.51 

2 

55 

69 

■  V  7 

0009 

Development 

1983- 

84 

1 

58 

.51 

2 

75 

0001 

X700  - 

ftQ 
oy 

1 

/  ^ 

.65 

z 

.79 

.0008 

Socio- Cultural 

1978- 

79 

2 

18 

.87 

2 

55 

69 

•  V  7 

Factors 

1983- 

84 

2 

27 

.90 

2 

75 

lid 

ftQ 
oy 

o 

.82 

Z 

yZ 

.79 

NS 

Standardized 

1978- 

79 

2 

92 

.90 

3 

18 

87 

flO 

Tests 

1983- 

84 

2 

83 

1 

.03 

3 

33 

78 

no 

1  Qftft. 

X700  - 

ftQ 
oy 

■» 

1 

.00 

.78 

NS 

Summative 

1978- 

79 

3 

38 

.77 

2 

64 

92 

•  7  ^ 

041  3 

Evaluation 

1983- 

84 

3 

.62 

.65 

2 

75 

.87 

.0093 

1988- 

89 

3 

.83 

.58 

2 

92 

.90 

.0071 

Systems 

1978- 

79 

3 

69 

.63 

2 

00 

63 

0001 

Concepts 

1983- 

84 

3 

92 

.28 

2 

.17 

'^9 

0001 
.  yjyjyj  x 

1988- 

89 

4 

.00 

.00 

2 

17 

S8 

0001 

.  \J\J\J  X 

Task/Content 

1978- 

79 

3 

.33 

.78 

1 

.82 

.60 

.0001 

Analysis 

1983- 

84 

3 

.92 

.29 

2 

.08 

.51 

.0001 

1988- 

89 

4 

.00 

.00 

2 

.33 

.78 

.0001 

Teaching 

1978- 

79 

2 

.83 

.94 

2 

.00 

.77 

.0310 

Methods 

1983- 

84 

3 

.08 

.95 

2 

.17 

.83 

.0187 

1988- 

89 

3 

.25 

.97 

2 

.42 

.79 

.0306 
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Table      1  (Continued) 


Topic 

Academic 

ID 

SD 

EP 

oU 

P 

Year 

Mean 

Mean 

Tele- 

1  07ft 
Ly  to 

70 

2 

.67 

78 

1 

.09 

.0001 

cuZLnunications 

Q 
J 

no 

49 

1 

.42 

70 

.  /7 

.0001 

1988 

-89 

3 

.17 

.58 

1 

.75 

1.06 

.0005 

Test  Item 

17/  C 

70 
-  /7 

2 

.82 

.87 

2 

.73 

.  7U 

xrc 

Writing 

-  0^ 

.  Id 

.80 

2 

.75 

.  87 

1988 

-89 

3 

.25 

.75 

2 

.75 

.97 

NS 

Test 

1  Q7ft 
l7  /  0 

70 

.18 

.87 

^ 

.64 

A7 

Mo 

Reliability/ 

X70  J 

AO 

.67 

3 

.  67 

MO 

Validity 

1988 

■89 

3 

.64 

.50 

3 

.67 

.63 

NS 

Transparency 

1  Q7ft 

l7  /  0  ' 

70 

■  IJ 

.15 

.90 

] 

.36 

Q9 

.  7^ 

nnm 

Production 

X70  J  ' 

•  Of 

.72 

.86 

1 

.33 

89 

nnm 

1988- 

■89 

2 

1.06 

1 

.90 

.0031 

Verbal 

1978- 

■79 

2 

07 

.98 

2 

82 

■ 

no 

Learning 

1983- 

-84 

2 

67 

.98 

2. 

92 

79 

■  /  7 

no 

1988- 

-89 

2. 

73 

1.01 

92 

.79 

NS 

Videotape/TV 

1978- 

79 

2. 

92 

.95 

1. 

09 

.30 

.0001 

Production 

1983- 

84 

2. 

92 

.76 

1. 

08 

.29 

.0001 

1988- 

89 

2. 

83 

.83 

1. 

25 

.45 

.0001 

Visual 

1978- 

79 

2. 

83 

.72 

2. 

00 

1.00 

.0310 

Learning 

1983- 

84 

2. 

75 

.87 

2. 

08 

.90 

NS 

1988- 

89 

2. 

92 

.79 

2. 

08 

.90 

.0250 
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Table  2 


Responses  for  Measures  of  Contact  Between  the  Two  Programs 
for  Nine  Institutions  With  Both  Chairpersons  Responding 


Contact  Characteristic  ID  EP 


Collaborative  research/ 


publication 

3 

( 

33%) 

2 

( 

22%) 

Comprehensive  exam  committees 

5 

( 

56%) 

5 

( 

56%) 

Dissertation  committees 

9 

(100%) 

9 

(100%) 

Faculty  committees 

7 

< 

78%) 

7 

( 

78%) 

Joint  faculty  appointments 

4 

< 

44%) 

2 

( 

22%) 

Joint  program  administration 

2 

( 

22%) 

1 

X 

( 

11%) 

Program  located  in  same  building  6 

( 

67%) 

■1 

( 

33%) 

Team- teaching 

2 

< 

22%) 

1 

( 

11%) 

Have  these  interactions  increased 
or  decreased  in  the  past  5  years: 

Increased 

3 

( 

33%) 

4 

( 

44%) 

No  change 

6 

( 

67%) 

5 

( 

56%) 

Decreased 

0 

( 

0%) 

0 

( 

0%) 

Anticipate  an  increase  in  the 
next  five  years: 

Yes 

4 

( 

50%) 

5 

( 

56%) 

No 

4 

( 

50%) 

4 

( 

44%) 
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INTRODUCTION 


ToUiard  Adaptive  Courseujart  Desions 

Assuming  that  computers  wi 1 1  play  an  incresingly  intergral 
role  in  the  educational  and  training  oi  individuals  in 
school  and  non-school  settings,  more  effective  ways  o-f 
utilizing  their  potential   should  be  investigated. 
Courseware  producers  are  beginning  to  transcend  the 
conceptual  and  instructional  constraints  imposed  by  the  -form 
O'f  most  dr  i  1 1 --and'prac  t  i  ce  and  tutorial  software.  Future 
e-f-forts  should  *focuS|  at  least  in  part,  on  exploiting  the 
i  nteract  i  ve  and  adapt  i  vt  capabi 1 i  t  i  es  oi  comouter  assi  sted 
instruction  rather  than  merely  using  the  computer  as  a 
presentation  device  for  text  and  graphics.  These 
capabilities  permit  greater  flexibility  in  courseware  than 
merely  providing  remedial  responses  to  multiple  choice 
questions.      Several   levels  of   interactivity  between  the 
user  and  the  computer  are  possible^  as  are  multiple  levels 
and  dimensions  of  possible  adaptations  by  the  courseware  to 
those  interactions  (Jonassen,  1985).    A  potentially 
important  adaptive,   interactive  courseware  design  diagnoses 
learners'"   intellectual   skills  and/or  cognitive  styles  prior 
to  instruction  and  then  adapts  the  instructional 
presentation  to  capitalize  on  the   individual  learner'^s 
processing  strengths  or  to  remediate  t^e  learner's  skill 
weaknesses  (Carrier  tc  Jonassen,   in  pre>s>.     Ross  (1984) 
recommends  "greater  emphasis  ...on  pretask  assessments  (eg. 
of  prior  achievement,  learner  backgraound,  etc.)  as  bases 
for  adaptation"  (p. 47).     Only  through  increasingly 
sophisticated  adaptive  sequences  will   the  computer  begin  to 
realize  the  tutorial  potent iai   of  a  Socrat  i  c  dial ogue . 

Assessing  Learner  Differences 

Many  measures  of   individual   differences  have  evolved  from 
individual,  projective  tests  to  take  the  form  of 
non-project  i  ve ,  paper-and-penc  il   tests  in  order  to  improve 
the  efficiency  of  the  test  while  maintaing  reliability  and 
validity.     For  instance,   the  cognitive  style,  field 
articulation  has  evolved  from  the  Body  Adjustment  Test, 
which  required  elaborate  apparati,  to  the  Rod  and  Frame 
Test,  with  less  elaborate  apparati,  to  the  individual 
paper-and-penc i  1  Embedded  Figures  Test,   rnd  finally  to  the 
group  administered  Group  Embedded  Figures  Test  and  Hidden 
Figures  Test.    The  next  step   is  to  embed  these  latter  tests 
into  courseware  as  a  means  for  diagnosing  learners'" 
processing  preferences.     Can  we  assume  that  these  tests  are 
adaptable  to  computer  display  without  affecting  performance? 
How  will  adaptation  of  these  tests  to  computer  display 
affect  their  validity  and  reliability?  Uill   the  limited 
resolution  of  computer  generated  graphic  presentations 
affect  the   information  processing  requirements  of  the  task? 
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li  instructional  adaptations  are  to  bt  predicated  on 
computer  tests  oi  cognitiue  and  perceptual   tasks,  uje  need  to 
be  certain  the  computer  testing  requires  the  same  perceptual 
and  intellectual  processes  as  the  paper-and-penc i 1  forms. 

Purpose  of  the  Study 

The  purr;jse  of  this  study  was  to  adapt  the  Hidden  Figures 
Test  to  microcomputer  display  and  to  assess  its  alternate 
form  re  1 i abi 1 i ty  when  compared  to  the  paper-and-penc i 1  test. 
The  Hidden  Figures  Test  (Ekstrom,  French  tc  Harmon,  1976)  is 
a  popular  measure  of  the  cognitive  style,  field 
articulation,  otherwise  known  as  field 

dependence/independence.  It  measures  the  ability  of  the 
subject  to  perceiv^e  and  separate  information  from  its 
surround i  ng  contextual   field.     Specifically,  subjects  are 
required  to  locate  one  of  five  simple  figures  in  several 
complex  patterns  (see  Figure  1).     Subjects  who  are  adept  are 
field  independent.      They  are  skilled  at  separating  stimuli 
from  their  surrounding  perceptual   field,  that   is,  their 
perception  is  i  ndepeden  t  of  the  perceptual   field  in  which  it 
is  embedded.     Field  independent  subjects  are  not  only  more 
skilled  at  locating  figures  in  patterns,  but  also  in  problem 
solving  and  other  cognitive  tasks  requiring  learners  to 
select  salient  cues  from  their  surrounoing  contextual  field, 
as  well   as  imposing  their  own  structures  on  information 
(Witkin  et  a1 ,  1977).     In  short,  they  are  more  analytical 
processors  of  all  forms  of  information.    These  procs-ssing 
differences  are  reflected  in  their  social    interactions  and 
career  choices,  with  field  independents  preferring  greater 
interpersonal  distances  and  fewer   interpersonal  relations. 
Field  articulation  has  also  been  related  to  intelligence, 
hemispherical  preference,  deductive  reasoning  ,  and  a  host 
of  other  constructs.     Since   it   is  one  of  the  most  reliable 
and  certainly  the  most  researched  cognitive  styles, 
reflecting  the  most  distinguishable  processing  differences, 
it   it  was  selected  to  test  the  effects  of  microcomputer 
display.     In  a  study  virtually  identical   to  this  one  only 
recently  discovered  after  collecting  the  data,  the 
paper-and-penc i 1  form  of  the  test  produced  higher  scores, 
though  the  alternate  form  re  1 i abi 1  i ty  was  significant, 
r=.57,  £<.05  (Jacobs,  Byrd,  &  High,  1985).     Only  32><  of  the 
variance  was  explained,  however,   indicating  a  weak 
alternative  form  reliability.     Despite  my  intention,  this 
study  may  furction  a»  a  replication  of  the  earlier  study. 


I nstrumen  ts 

The  Hidden  Figures  Test,  Form  CFl ,  Revised,   is  from  the  Kit 
of  Factor  Referenced  Cognitive  Tests  (French,  Ekstrom  & 
Price,   1976).     It  consists  of  two  parts,  each  with  16 
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complex  p&tterns  in  which  are  tmbtdded  one  o-}  five  simple 
figures  <see  Figure  1).     Part  one,  queitions  1-16|  was  used 
in   i  ts  paper-and-penc  i  1   -form.     Part  two,  quest  i  ons  17-3?> 
was  converted  to  computer  display.     It  was  programmed  in 
Applesoft  BASIC  for  display  on  12  inch,  monochrome  <green 
screen)  monitors  with  Apple  lie  computers.    Th^   figures  and 
patterns  were  constructed  in  page  1  of  Apple  high  resolution 
graphics.    This  provided  a  four  1;ne  text  window  at  the 
boltom  of  the  screen  for  qiving  directions.     Resolution  in 
this  mode  is  286  horizon  a1  pixels  by  160  vertical  p':xe1&. 
All  of  the  figures  and  patterns  in  the  computer  version  were 
identical   in  proportion  nearly  identical    in  size  to  those  i  n 
Che  paper-and-penc i 1  version.     The  timing  and  scoring  were 
the  same.     The  instructions  for  now  to  perform  the  tasK  were 
taken  verbatim  from  the  paper  version.    To  those  were  added 
instructions  in  how  to  manipulate  the  screens.  The  primary 
di  f  f  erence  between  the  versions  was  in  ti.e  number  of 
patterns  visible  to  the  subjects  at  any  time.     In  the 
paper-and-penc i 1  version,   the  16  figures  arc  displayed  on 
two  pages,  with  3  rows  of  patterns  cn  each  page.  Four  of 
those  rows  contained  3  patterns,  and  the  last  2  contained  2 
patterns  per  pom.      Because  of  limited  size  of  the  computer 
terminal,  the  three  rows  of  figures  could  not  be  displayed 
simultaneously.     So,  the  five  simple  figures  were  always 
displayed  at  the  top  of  the  screen  with  a  single  row  of 
patterns  (either  2  or  3)  displayed  in  the  middle  of  the 
screen  <«*e  Figure  2).     The  rows  appeared  in  the  same  o^der, 
arrangement,  and  proportion  as  they  did  in  the 
paper-and-penc i 1   t^st.  Subjects  could  flip  between  each  of 
the  rows  simply  by  pressing  the  right  or  left  arrow  keys  at 
the  t-iottom  of  th*  keyboard.    The  computer  required  1.2 
seconds  to  clear  the  screen  and  form  the  new  row  of  figures. 
The  numbers  of  the  patterns  were  displayed  dtrectly  beneath 
each  pattern.     The  otht.     difference  between  the  two  versions 
was  in  how  the  subjects  recorded  their  answers.     In  the 
paper^and-j^enc  i  1   test,   the  letters  A-E  <  correspond  i  ng  to  the 
figures  in  the  top  row>  were  displayed  b  neath  each  pattern. 
The  subjects  were   instructed  to  circle  the  letter 
corresponding  to  t* e  figure  which  they  thought  was  embedded 
in  the  pattern.     ^n  the  computer  version,  when  subjects 
wanted  to  answer,   they  pressed  the  letter  A  (for  ansv».^r)^ 
In  the  text  winaow  at  the  bottom  of  the  screen,  they  were 
prompted:  "In  which  pattern  did  you  find  a  figure?"  They 
were   instructed  to  type  a  number  between  1-16  followed  by  a 
return.  Any  other  response  but  a  rmmber  between  1-16 
r  e       ted  in  a  remdi  a1  messay .»   instrjcting  them  to  respond 
wi  ti    a  number  Lrtuieen  1-16.     Thev  were  next  prompted:  "Which 
figure  did  you  f^nd  in  pattern  pa\: ter n  number?"     They  were 
prompted  to  respond  with  a  letter  A-E  and  a  return.  They 
were  then  given  confirmaticp  of  their  response  with  the 
opportunity  to  alter  their  response^   "Figure          is  in 
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Pattern   .  Corrtct  <Y  or  N)?"  A  "y"   t:^ed  in  would  clear 

the  text  windowi  except  -for  the  screen  manipulation  prompts. 
All  other  keys  on  the  keyboardi  except  the  numerals  and  the 
letter  A-E,  Y,  and  N  were  deactivated. 

P«ir  t  i  c  i  Dan  ts 

The  participants  included  58  upper-level  undergraduate  and 
graduate  students  in  education  and  library  science  at  a 
southeastern  university.    They  were  predominately  <91.4X) 
-female.    The  mean  score  -for  all  subjects  was  4.9c       lich  is 
equivalent  to  norms  -for  this  group  established  in  ^ther 
investigations.     So  the  participants  in  this  student  were 
-fairly  normal  with  regard  to  the  task  measured  by  the  test. 
Al '   subjects  had  some  prior  experience  with  mi crocomputerSi 
though  the  level  o-f  experience  varied. 

Procedure 

One  group  <n=38)  was  administered  the  print  version  j-f  the 
test  -first,  -followed  immediately  by  the  computer  version. 
The  other  group  <n.=2e)  received  the  computer  version  -f'rst, 
in  order  to  control   -for  order  e-f-fect.    The  tests  were  always 
administered  in  immediate  succession.    The  only  delays 
incurred  were  -for  changing  roomsi   ie.  moving  to  and  -from  the 
computer  lab,  which  was  less  thyn  180  -feet  away.     For  each 
admi nstrat i on ,   the  experimenter  read  the  instructions  and 
the  subjects  completed  the  sample  items.    Any  questions 

were  answered  prior  to  thd  beginning  o-f  the  test.  The  Hidden 
Figures  Test  is  a  timed  test.     Subjects  were  given  12 
minutes  to  complete  each  version  o-f  the  test. 

RESULTS 

Pearsor.  product  momment  correlations  were  calculated  -for  the 
paper -and-penc  i  1   and  computer  *.»ersions  o-f  the  xest.  There 
^as  a  signi-ficant  re  1  at  i  on<>ii  i  p  between  the  two  versions, 
r=.484,  £<.e5.     The  s  i  gn  i -f  i  cance  o-f  this  relationship  should 
be  tempered  by  the  -fact  that  the  relationship  accounted  -for 
only  23. 4X  o-f  the  variance  between  the  scores. 

In  order  to  lest  -for  order  e-f-fect,  a  two--way  analysis  o-f 
vjiriance  was  calculated  -for  the  mean  scores  presented  in 
Tabl  e  1.     Table  1   indicates  that  -for  the  group  which 
received  the  pap?r  version  -first,   the  mean  scores  on  both 
t»sts  were  equivalent  <M=4.71).  However,  -f       the  group 
receiving  the  computer  version  -first,  the      scores  on  the 
conputer  ve  sicn  were  s  i  on  i -f  i  c  ant  1  y  lower  on  the  computer 
uersion  <t^^.55)  than  on  the  paper  version  <r^5.20).  The 
analysis  o-f  variance   indicated  no  ma.n  e-f-fect  -for  order  o-f 
treatment .     The  paper  -first  group  per -formed  bet  ter  <M=4 . 71 ) 
on  the  combined  scores  than  the  computer  -first  group 
<>1«3.875),  however  the  di-f-ference  was  not  signi-ficant.  There 
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was  a  signi-ficant  *nain  e-f-fect  "for  version  O'f  the  test, 
F=5.12,  £<.81.     Scores  -for  the  paper  version  <M«4.96>  were 
higher  than  the  scores  -for  the  computer  version  <M=3.63>. 
The  interaction  was  also  si  gn  i -f  i  cant ,  F^S.  12y£<  .85| 
indicating  a  significant  order  e-f-fect  -for  the  computer  -first 
group  only.     Uhen  the  subjects  received  the  print  version 
•first,   they  per-formed  as  well  on  the  computer  version. 
However,  when  they  received  the  computer  version  -first, 
the  i  r  performance  on  the  print  version  imp roved 
s  1  gn  i  -f  i  can  1 1  y . 


There   is  evidence  which   indicates  that  by  adapting 
perceptual   and  cognitive  test,  such  as  those  -for  -fi^ld 
dependence/independence,  you  lose  both  -face  and  construct 
validity.     Streibel   (1981),    in  a  series  o-f  experiments  with 
the  Embedded  Figures  Test,  -found  that  by  increasing  the  size 
o-f  the  embedded  figures  by  a  factor  of  eight,   the  nature  of 
the  performance  was  altered.  Field  dependent  subjects  became 
more  field  independent,  and  field  independent  subjects 
became  more  field  dependent.     In  this  study,  serious 
questions  about  the  f:^ce  validity  cf  a  computer  version  of 
the  Hidden  Figure  Test  were  raised.    Uh 1 1 e  there  was  a 
significant  correlation   in  the  scores  on  both  vers i  on  of  the 
same  test,     the  analysis  of  variance  indicated  that  they 
could  not  be  Judged  alternate  forms  of  the  same  test.  The 
performance,  as  a  function  of  order  of  testing,  varied  too 
extensively.     This  is  especia!^y  important  when  we  consider 
that  in  a  computer  managed  instructional   environment,  where 
the  computer  would  conduct  the  diagnostic  testing,  the 
computer  version  would  replace  the  print  version.  The 
scores  on  the   initial   admi  n  i  strat  i  on  of  the  compute*-  vers i  on 
were  significantly  lower  than  the   initial  admi  n  i  sti  «.  J  on  of 
the  paper-and-penc i 1   version.     This  lower  score  corroborates 
the  conclusions  of  Jacobs  et  al   C1985)   that  the  computer 
version   is  probably  measuring  other  constructs  such  as 
computer  anxiety,  which  is  a  function  of  prior  computer 
experience.     There  was  anecdotal   evidence  that  the 
perceptual   constructs  being  measured  were  also  different.  A 
number  of  subjects,  especially  those   in  the  print-first 
group  thought  the  computer  version  was  easier,  because  the 
diagonal   lines  generated  by  the  computer  (2  pixels  wide) 
were  easier  to  distinguish  and  compare.  Obviously, 
additional   practice  with  performing  perceptual   tasks  on  the 
computer  may  well  have  reduced  the  effects  of  computer 
testing  in  this  study.     Additionally,   the  use  of  a  higher 
resolution  screen  may  have  produced  more  equivalent 
performances.    This  stuoy  should  be  replicated,  adding  at 
least  one  more  level   of  resolution  as  a  test  for  that 
factor.    The  use  of  computers  to  administer  perceptual  and 
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cognitive  t#st&  is  clearly  in  the  developmental  stage.  A 
lot  of  additional  Mork  is  necessary  before  Me  can  assume 
construct  and  face  v^alidity  betuieen  alternate  (computer  vs. 
print)  forms  of  administration. 
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INTRODUCTION 


It  is  generally  accepted  that  the  exponential  growth  o-f 
microcomputers  in  education  and  the  workplace  has  produced  an 
adverse  reaction  in  many  people  that  is  re-ferred  to  as 
"computerphobi  a" ,   ie.  -fear  o-f  computers.    According  to  Jay 
(1981),  those    u-f-fering  -from  computer  phobia: 

«  are  resistant  to  talking  or  thinking  about  computers, 

«  have  hostile  and  aggressive  thoughts  about  computers,  and 

«  -fear  and  become  anxious  about  computers. 

Another,  more  widely  used  term  -for  computer  phobia  is  computer 
anxiety.     Computer  anxiety  results  -from  -fear  or  apprehension  when 
using  computers  or  when  -faced  with  the  prospect  o-f  using 
computers.     Such  -fears  may  be  rational   or   irrational.  Many 
people  have  per-fectly  normal  reasons  -for  fearing  computers 
(Rubin,  1983),  such  as  -fear  o-f  displacement,   loss  o-f  control,  no 
time  to  learn  to  use  them,  -fear  o-f  -failure,  -fear  o-f  breaking  the 
computer,  and  (inevitably)  unclear  documentation.     Such  -fears,  he 
documents,  o-ften  produce  the  hostile  reactions  toward  computers. 
Irrational  -fears,  those  without  explanation,  are  the  cause  o-f 
computerphobi a,  which  in  turn  results  in  computer  anxiety. 
Maurer  and  Simonson  (1984)  enumerate  behaviors  that  are 
associated  with  computer  anxiety,  such  as: 

*  avoidance  o-f  computers  and  the  area  in  which  they  are 
1  oc  a  t  e  d , 

*  excessive  caution, 

«  negative  remarks,  and 

*  attempts  to  cut  short  the  necessary  use  o-f  computers. 

Computer  anxiety  is  generitlly  regarded  as  an   iiistance  o-f  state 
anxiety.     State  anxiety  is  situational,  that   is,   it  results 
directly  -from  some  stress-producing  situation  during  a  -finite 
period  o-f  time.     Raub  (1981)  contends,  however,   that  the  state 
anxiety  associated  with  computer  phobia  will  more  likely  result 
in  people  with  higher  trait  anxiety.    Trait  anxiety  is  a  more 
enduring  and  permanent  characteristic  tendency  to  be  anxious. 

Computer  anxiety  tends  tu  be  gender  speci-fic,  with  many  more 
women  -fear-ful   o-f  computers  because  socialization  makes  them  less 
receptive  to  computers  (Winkle  it  Matthews,  1982).  Computer 
equity  is  an  important  issue  which  should  stimulate  a-f -f  i  rmat  i  ve 
action  e-f-forts  (Bakon,  et  al  ,  1983). 

While  comp  ter  anxiety  is  a  generally  accepted  phenomenon,  its 
existence  i»  o-f^en  based  on  anecdotdil  data.     We  have  no  empirical 
proo-f  o-f   its  existence,  which  raises  the  possibility  that   it  may 
be  more  constructed  than  real,  based  upon  our  expectations. 
Sociologically  speaking,   there   is  good  reason  to  expect  computer 
anxiety.     As  we  have  all   sat  down  to  learn  a  new  software 
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package,  we  have  -felt  the  pangs  o-f  anxiety.     Yet,   there  is  no 
support  -for  the  pervasive  e-f-fects  that  are  o-ften  documented  in 
the  literature.    The  purpose  o-f  this  study  was  to  empriricaliy 
document  whether   increased  levels  o-f  state  anxiety  are  in  -fact 
associated  with  the  use  o-f  microcomputers,  thereby  producing  the 
anxiety-related  behaviors  enumerated  by  Maurer  and  Simonson 
(1984).    While  they  used  the  sam»  instrument  as  this  study,  the 
results  were  used  to  validate  a  Computer  Anxiety  Inventory  ^ather 
than  to  establish  the  existence  of  computer  anxiety.  In 
addition,  they  administered  the  anxiety  measure   in  its  print 
-form.     In  order  to  assess  whether  state  anxiety  increases  Aihen 
using  microcomputers,  the  state  anxiety  measure  in  this  study  was 
administered  by  the  computer. 


Part  i  c  i  pants 

116  undergraduate  and  graduate  education  end  library  science 

majors  with  an  age  range  o-f  28  to  55,  enrolled  at  a  sou thi>astern 
un  i  versi  ty . 

Instruments 

State-Trait  Anxiety  Inventory,  Form  Y  <Sp i el berger ,  1983)   is  an 
inventory  which  assesses     levels  o-F  anxiety  states,  such  as 
tension,  apprehension,  worry,  etc.     Based  upon  the  personality 
theory  outlined  Dy  Spielberger  <1972>,  the  test   is  divided  into 
two  parts.     Part  1  assess  state  anxiety,  a  transitory,  momentary 
state  o-f  c.nxiety.    These  personality  states  can  become  more 
stable  over  time.     Trait  anxiety,  as  measured  by  the  STAI  ,  re-fers 
to  a  stable  individual   di-f-ference  o-f  anxiety  proneness  which  may 
result   in  elevated  state  anxiety  in  situations  perceived  by  the 
person  as  threatening.     The  trait  portion  was  adminstered  to  all 
participants  in  its  print  -form.     Hal-f  the  participants  also 
received  the  print  -form  o-f  the  state  portion  o-f  the  test.  The 
state  portion  was  converted  to  an  auto-boot  program  -for  the  Apple 
He  which  presented  each  question   individually  with  the  likert 
scale  presented  beneath  each  question  (see  Figure  1>.  A-fter 
answering,  subjects  were  askea  to  con-firm  their  responses.  This 
enabled  them  to  change  their  responses  because  o-f  a  change  o-f 
miriu,  keyboarding  error,  etc.     A-fter  the  20th  question,  an 
additional   question  was  presented  which  asked  the  participant  to 
classi-fy  the  level   o-f  their  computer  expereince  (from  "Never  u^ed 
one"   to  "Use  one  all   the  time".     The  compucer  then  wrote  th^ 
participants'  answers  off  to  disc.     A  program  was  written  to 
score  the  state  tests  and  print  out  the  results. 

Procedure 

The  control   group  (58  students)  received  both  portions  of  the 
test   in  a  norrral   classroom  environment.     The  i»xper  imental  group 
(58  students)  received  the  trait  portion   in  class  and  then 
proceded  to  the  computer  lab  for  an  introductory  lesson  in 
computer  assisted  instruction  during  which  they  completed  tie 
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state  portion  o-f  the  test  on  the  computer. 


RESULTS 


Exposure  to  Computer 

The  means  -for  the  two  groups  <^58  each),  one  completing  the 
state  anxiety  portion  online  and  the  other  completing  it   'n  print 
■form,  were  compared  statistically.    No  significant  di-f-ference 
between  the  groups  were  -found,  l<n4>«1.^4,  £>.05.    The  state 
anxiety  scores  o-f  the  computer  group  <M«48.24>  were  substantially 
higher  than  the  print  group  <t^36.12>,  but  within  group  variance 
was  so  high  -for  the  computer  group  that  no  statistical  di-f-ference 
occurred.    The  trait  anxiety  scores  <tf^36.59  and  {^36.79)  were 
virtually  equivalent,  I<n4>"-B.i3. 

Level  o-f  Computer  Experience 

At  the  end  o-f  the  computor-admi  n  i  sterd  state  anxiety  inventory, 
participants  were  asked  to  classi-fy  on  a  -five-element  semantic 
di-f-f  erenti  al   their  level  o-f  experience  with  microcomputers. 
Based  upon  their  declared  levels  o-f  experience,   they  were  broken 
into  -five  groups  o-f  unequal  size  with  the  most  indicating  a 
moderate  level  o-f  experience  and  only  three  indicating  a  high 
level  o-f  experience.    An  analysis  o-f  variance  o-f  the  state 
anxiety  scores  o-f  these  -five  groups  indicated  no  signi-ficant 
di-f-ference,  F<4)»B.83,  £>.05. 

Sex  Pi -f -f  erences 

Only  six  members  o-f  the  experimental   group  were  males.  Their 
level  o-f  state  anxiety,  predictably  lower  -from  the  literature, 
were   in  -fact  slightly  lower  <tl«46.12>   than  the  -females  (2^=48. 36). 
The  di-f-ference  however  was  not  signi-ficant,  t.<56>«-8.36,£>  .05. 
There  was  no  di-f-ference   in  trait  anxiety  scores  either. 


This  study  provides  some  statistically  inconclusive  evidence  o-f 
increased  anxiety  st&tes  when  exposed  to  microcomputers.  For 
many  educators,   they  are  still  novel   enough  to  produce  some 
anxiety.    An   increase   in  state  axiety  should  be  mitigated  by 
increased  exposure  to  microcomputers.    Microcomputers  do  not 
produce  irrational  -fear  among  educators,  as  evidenced  by  this 
study.    The  setting  (moving  -from  the  classroom  to  a  computer  lab) 
could  have  produced  the  marginal    increase   in  state  anxiety.  The 
stongest  predictor  o-f  state  anxiety  was  still   trait  anxiety, 
F(2)  =  12.10,  E.<.05,  although  it  accounted  -for  less  then  Id*/,  o-f  the 
variance.     The  treatment  -factor  added  no  signi-ficant  amount  to 
that.     It  appears  that  these  results,   like  mosl  produced  by 
educational  research,  are  greatly  a-f-fected  by  individual 
di -f-f  erences,  as   indicated  by  the  high  level  o-f  within-group 
var I ance . 
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The  computer  equity  issue  Mas  not  supported  by  this  study, 
although  the  inequity  in  group  size  makes  the  analysis  suspec  • 
For  this  group  O'f  professional   and  pre-prof  ess  i  onal  students, 
anxiety  touiard  computers  should  not  be  as  great  as  among  younger 
students.    Most  of  the  large  sex  di f erences  seem  to  occur  in 
Junior  high  and  high  school. 

The  solution  for  compu lerphobi a  or  computer  anxiety  is  computer 
literacy  (Lawton  tc  Gerschner,   1982).     Computer  tension  may  also 
be  reduced  by  using  a  comparative  organizer  to  relate  computer 
using  decisions  to  the  more  familar  process  of  selecting  and 
using  a  classroom  film  (Rottier,   1982).    This  metaphorical 
approach  is  the  basis  for  developing  elaborate  "training  wheels 
systems*"  described  in  the  human  factors  literature. 
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ABSTRACT 


This  study  compared  the  e-f-ficiency  (time)  and  accuracy  o-f  list 
^rsus  -flow  chart  representations  o-f  the  tas*^  oi  using  indexes 
to  search  -for  document  numbers  in  the  U.S.  Documents  lionthi  y 
Cat  a1  OQ.     Participants  '  nde>.?nden  1 1  y  used  the  algorithms  and 
were  timed  in  a  real  world  setting.     Both  groups  per-formed  at  a 
92X  accuracy  level.     Both  groups  required  virtually  identical 
times  to  locate  document  numbers  using  each  of  the  -four  indexes 
o-f  the  ^iitalog,   though  the  range  o-f  time  and  resultai.t 
variances  were  high.     It  appears  thac  the  -form  o-f  representing 
algorithms  has  no  e-f-fect  on  the  algorithmic  procoss  during  a 
search  task . 


Algorithms  are  o-ften  used  in  education  to  depict  general 
procedures  wh  i  ch  descr  i  be  a  cl  ass  o-f  probi  ems .     Al  gor  <  thm i  c 
procedures  normal  ly  are  distinguished  -from  linear  procedwi  ?s, 
which  are  represented  as  sequential   lists  o-f  discrete 
operat  i  ons.     Al  gor  i  thms,  on  the  other  hand,  represent  d'j-c  i  si  on 
rule  procedures  in  which  a  set  o-f  rules  is  systematically 
employed  to  maKe  decisions  and  take  appropriate  actions. 
Algorithms  art  designed  so  that  they  always  produce  the  correct 
result,  gi^'en  any  o-f  a  class  oi  decision  rule  problems.  They 
may  serve  as  instructional  media  or  as  job  performance  aids, 
which  indirectly  instruct  users.     Numerous  studies  have 
verified  the  effectiveness  and  efficiency  of  algorithms  as 
instructional  media  (Landa,   1974;  Scandura  et  al ,   1971;  Schmid 
et  al ,   1976) . 

While  many  people  associate   instructional   algorithms  with  flow 
charts,  Merrill   (1988)    illustrated  four  diffc  ?nt 
r?presentat i ons  for  algorithms  —  decisijn  tree,  decision 
table,  flow  chart  and  lift  representations.     In  this  study  we 
compared  the  efficiency  and  accuracy  of  two  of  the  more  popular 
representations,  flow  chart  and  list  representations,  for 
-^c  -  1 1  i  *-at  i  ng  a  search  task.     Very  little  research  was  availble 
to  assist  us  in  generating  hypotheses.     Coscarelli  (1978) 
r-D-»rted  that  the  form  of  representation  (list  vs.  flow  chart 
vs.  prosed  did  not  affect  critical    thinking  ability  or  course 
gr<*aes,  however,  using  flow  chart  algorithms,  students  reduced 
their  completion  times.       Coscarelli    (1^78)  believed  that 
different  representations  for  algorithm>  possessed  different 
media  codes,  which  should  affect  the  recoding  of  information 
into  ment&l   operations.     Recoding  differences  should  result  in 
performance  differences.     In  a  ctudy  employing  1  irni  ted 
I  nf  ormrst  i  on  processing  tasks,  flow  charts  were  found  to  produce 
faster  decision  making  thari  lists,  with  an  eruivalent  level  of 
accuracy  (Holland  &  Rose,   ^981).     Evidence  seems  to  indicate 
what  flowchart  representations  of  algorithms  enables  users  to 
learp  more  efficiently.     The  questio^if^  that  we  addressed  was, 
would  tnese  results  general  ire  to  am<»aningful   search  task 
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per-formed  witout  assistance   in  a  real-world  set^ing^ 


METHOD 


Part  i  c  i  pants 

55  undergraduates  and  5  adul  ts  at  the  V^irginia  Military 
Institute  <26  male,  4  female). 

Mater  i  a1 s 

Two  sets  (flow  chart  arJ  list)  of  six  algorithms  were  developed 
and  field  tested.     Each  set  of  algorithms  depicted  the 
decision-rule  procedure  for  using  each  of  the  indexes  (subject, 
author,   title,  and  keyword)     and  locating  document  numbers  in 
the  Monthly  CataloQ,   the  prim^^ry  accession  tool   to  U.S. 
Government  Documents  in  depository  libraries.     The  first 
algorithm  in  each  set  presented  decisions  which  led  to  the 
appropriate  algorithm  and  index.     Each  of  the  next  four 
algorithms  in  each  set  directed  the  users  through  each  of  the 
indexes  ^see  "figures  1  and  2  for  examples  of  both  types  of 
algorithms  for  one   index).     The  final   elgorithm  s'lo-ifc'ed  how  to 
find  the  document  number  in  the  catalog.     The  algorithms 
consisted  of  an  average  of  3  decision  steps  and  5  action  steps. 
The  flow  chart  versions  usea  four  common  flow  charting  figures 
(rectangle,  diamond,  oval,  and  circle)   to  represent  action, 
decision,   terminal,  &nd  connector  steps  respectively.  The 
steps  for  th ^  list  representations  used  the  same  directions 
presented  in  a  numbered  list  sequen'te,  with  decision  options 
referencing  different  step  numbers.     Both  sets  of  algorithms 
u.ere  presented  on  six  8  1/2"  X  11"  pages. 

Procedure 

Content  val  i  di  ty  was  establ  i  shed  by  submi  tt  i  ng  the  mater  i  al  s 
for  review  b/  the  head  documents  librarian  and  a  library 
science  professor.     Then,  each  set  of  algorithms  was  pilot 
tested  with  naive  users.     No  changes  were  found  necessary.  The 
participants  in  the  study  were  unfamiliar  w  Ih  either  the 
Month!/  Catalog  or  the  use  of  algorithm:.     They  were  randomly 
assigned  to  treatment  group  (list  and  flow  chart).     Each  was 
first  Qiven  an   instruction  sheet  and  practice  exercise  on  how 
to  use  their  respective  type  of  algorithm.     Next,  all 
participants  we'^e  presented  individually  with  the  set  of 
algorithms  and  a  sex  of  four  problems,  each  requiring  the  use 
of  a  different   index   in  order  to  locate  a  citation  and  then  the 
document  number.     That   is,   the  search  required  each  user  to  use 
one  algorithm  to  determine  the  needed  index,  a  secono 
i  ndex--spec  i  f  I  c  algorithm  to  find  the  citation,  and  a  third  to 
locate  the  SUDOC  number.     Only  the  Month! y  Cata^  oqs  for  the 
years  1980-1933  were  used  for  searching,     n  order   to  limit  the 
^cope  of  the  tasK.     The  order  of  the  proolems  was  randomized. 
Each  participant  was  i  nd  i  v- i  dual  1  y  timed  as  s/he  woi  ked  through 
the  algorithms  in  order  tc   locate  the  document  number  taking  as 
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long  as  they  needed  to  locate   it.     They  were  told  not  to 
request  assistance  unless  absolutely  necessary.  Following 
treatment,  each  participant  completed  the  Extended  Range 
Vocabulary  Test  -from  the  Kit  o-f  Factor  Re-ferenced  Cognitive 
Tests  as  a  global  measure  o-f  verbal  ability. 


Verbal   abi 1  i  ty 

There  was  no  di-f-ference  between  groups  on  the  -first  part  ci  the 
Extended  Range  Vocabulary  test  (M(  1  i  st  )  =  i  2 . 47  and  M(-flow 
chart)=12.93) .     We  concluded  that  both  groups  were  equivalent 
in  the  i  r  read i  ng  abi 1  i  ty . 

Accuracy 

Both  groups  completed  the  questions  with  91.77.  accuracy.  The 
■flow  chart  group  (n.=9)  had  a  si  gn  i -f  i  can  1 1  y  greater  number  o-f 
requests  -for  assistance  than  did  the  list  representation  group 
(n=2) ,X  (1)=5.67,  £<.e2.     These  requests  related  to  the 
procedure  -for  locating  the   indexes  or  which  index  to  locate. 

Time 

Only  minute  d  i -f -f  erences  in  the  times  required  by  participants 
to  locate  documents  resulted  (see  Table  1).     The  list  group 
(M=5.24)  completed  their  problems  only  slightly  -faster  than  the 
■flow  ch   ^t  group  (M=5.28).     The  range  o-f  times  'was  very  high, 
producing  a  large  amount  of  variance   i  ri  the  data.    The  analysis 
o-f  variance   indicated  a  significant  ma  in  e-f-fect.     Post  hoc 
analysis  indicated  the  the  title  proolem  required  significantly 
less  time  (M=4.39)   than  the  other  questions  (M=5.42).  The 
quest  I  on  by  treatment    i  n  terac  1 1 on  was  not  significant 
indicating  no  differntial   effects  of  treatinent. 


The  use  of  algorithms  to  introduce  search  procedures  is 
effective   insofar  as  most  of  the  naive  users  were  able  to 
1 ocale  the   i  n format  i  on  they  sought   independently.     AT  so,  the 
experience  was  positively  received  by  all   participants.  Most 
of  them  reported  positive  att'tudcs  toward  the  use  of 
algorithms.     Since  the  effectiveness  of  algorithms  relative  to 
list  procedures  has  already  been  established,   this  study  was 
concerned  with  alternative  methods  for  representing  tne  samp 
algorithmic  process.       However,   the  form  of  representation 
appears  to  have  little  effect  on  the  efficiency  of  the  search. 
The  accuracy  of  tne  search  does  not  seem  to  be  affected  either, 
at  least   in  terms  of   the  proportion  of  citations  located. 
Holland  and  Rose  (1981)  recommended  practice  with  algorithms 
pr  i  or  to  performance  because   they  (both  list  and  f 1 ow  chart) 
are  generally  unfamiliar  forms  of   instruction.     They  found  that 
the  flow  chart,  after  practice,  t-licits  the  best  performance. 
The  greater  number  of  requests  for  assistance   in  this  study  by 
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the  flow  chart  u^ers  was  probably  attributable  to  the  novelty 
o-f  that  -form  o'-f   instruction.     So,  with  practice,   the  e-f-ficiency 
o-f  the  -flow  chart  group   in  this  study  might  have  improved. 
Practice  with  any  procedure   is  important.     However,    it  was 
deemed  likely  that  in  an  engineering-oriented,  predominantly 
male  school   (such  as  the  one   in  which  the  study  was  conducted) 
that  some  o-f  the  participants  were  -familiar  with  -flow  charting. 
The   intent  o-f  this  study  was  to  investigate  the  use  the 
algorithms  -for  providing  independent  access  to  materials  in 
order  to  supplant  the  need  -for  personnel   to  assist   in  the 
process.     While  either  -form  may  be  used  with  equivalent 
e-f-ficiency  and  resultant  accuracy,   the  additional   requests  -for 
assistance,   i -f  -found  to  be  a  consistent  trend  among  naive 
users,  would  suggest  the  pre-ferred  use  o-f  list  algorithms. 

However,    the  e-f-ficiency  and  resultant  accuracy  o-f  the  two 
df-f-ferent  -forms  o-f  algorithms  in  this  study  suggest  that   it  is 
the  technology  o-f  a1  gor  i  thmi  zat  i  on  that  makes  the  processing 
di-f-ference  -  not  the  -form  o-f   its  representation.     The  media 
codes  are  structural   and  there-fore   implicit   in  the  algorithmic 
process  and  not  speci-fic  to  its  -form  o-f  representation. 
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Table  1 

Mean  Location  Times  -for  Indexes 
by  Type  o-f  Algorithm  Used 


Au thor    Title  Subject  Keyword 


List 

6.95 

4.11  4.97 

5 . 48 

Fl owchar  t 

5.49 

4.85  6.94 

;) .  51 

Table 
Resu  1  ts  o-f  Two- 

2 

Way  ANOv'A 

Sum  o-f 

Degrees  o-f 

Mean 

F 

Squar  es 

Freedom 

Squares 

Type  Search 

29.01 

3 

9.67 

1 

.16 

Treatmen  t 

3.05 

1 

3.95 

9 

.365 

Type  X  Treat 

.  12.05 

3 

4.02 

9 

.481 

Error 

935.69 

112 

Total 

979.81 

119 
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Figure  2  ^ 


List  Representation  of  Algorithm 


1)  Start  here  with  the  AUTHOR  of  a  government  document. 

2)  Find  the  CUMULATIVE  AUTHOR  INDEX  to  the  Monthly  Catalog.  The 
indexes,  along  with  the  Monthly  Catalog,  are  located  on  Index  Table 


3)  Select  the  AUTHOR  INDEX  volume  for  the  year  your  document  was 
published.     If  you  do  not  know  the  year,  use  your  best  guess. 

4)  Is  your  AUTHOR  one  or  more  persons?    If  yes,  go  to  Step  5.    If  no, 
go  to  Step  6. 

5)  Select  one  of  your  AUTHORS  and  look  up  the  last  name,  followed  by 
the  first  name  or  :-^itials.    Go  to  Step  7. 

6)  Your  AUTHOR  must  be  a  corporate  or  government  agency.    Look  up  the 
first  major  word  in  the  corporate  agency.    Do  not  usr  a_,  an,  the. 

7)  Did  you  find  your  AUTHOR?    If  no,  you  may  have  the  wrong  year.  Go 
back  to  Step  3  and  select  the  year  earlier  or  the  year  later. 

If  yes,  go  to  Step  8. 

8)  There  Toay  be  more  than  one  title  attributed  to  your  AUTHOR.  Select 
the  one  you  want-     Find  the  ENTRY  NUMBER  following  the  title. 

9)  The  ENTP.Y  NUMBER  looks  like  this:    83-16997.    The  first  two  digics 
(83)  indicate  the  year  and  voluce  nunber  of  the  Monthly  Catalog. 

Write  down  your  ENTRY  NUMBER. 

10)  Find  the  volume  of  the  Monthly  Catalog  for  the  year  indicated  by 
your  ENTRY  NUMBER.       ENTRIES   are  listed  in  nuaiericai  order.  The 
numbers  contained  in  a  volume  are  indicated  on  the  spine. 

11)  Did  you  find  your  EliTRY?         If  no,  you  nay  have  the  wrong  volume. 
LooR  at  the  inclusive  numbers  listed  on  the  spine  to  see  if  yours 
fit.     Go  back  to  Step  10.    If  yes,  go  to  Page  6. 
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Find  the  CUMULATIVE 
AUTHOR  INDEX  to  fhe 
Monthly  Catalog. 


*  The  cumulative 

*  indexes  and  the 
 ^»  Monthly  Catalog 

>  are  on  Index  Table 


I 


Select  the  AUTHOR  INDEX 
for  the  year  your  document 
was  published.    If  you  do 
not  know  the  year,  use 
your  best  giicsa. 


Then  your  /^UTHOR 
is  a  corporate  or 
governnent  agency. 
Look  up  the  agency 
using  the  first 
major  word.    Do  not 
use  a,  an,  the. 


Choose  one  of  the  AUTHOPS. 
Look  up  AUTHOR'S  last  name 
in  the  yearly  index  closest 
te  publication  date. 


\o\i  iray  have  the 
wrong  year.  Try  the 
AUTHOR  INDEX  for  the 
year  earlier  or  later. 


Yes 


Find  ENTRY  NUMBER  following 
title.    Vri'     it  down. 


|The  ENTRY  NUMBER  I 
iwill  look  like  this:  ^ 
183-16997  j 
183  -  Year  h  vol.  bd.  of' 
-A'  Monthly  Catalog. 
1 16997"^  ERTRY  AUi'lsi'H  | 
I         listec*  iricallyl 

I_  ^  in  ^c_  "iiPlr  «  ' 
"  7 


Find  Monthly  Catalog  'or  year 
indicated  by  the  ENTR^  NUMBER 
described  in  previous  step. 


You  may  have  the 
wrong  volume.  Look 
St  the  inclusive 
oumbers  listed  on  the 
spine  to  see  if  your 
numbers  fit. 


I  ENTHIESincludcd 
'Tlin  a  volume  are 

(indicated  on  the  spine 
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BACKGROUND 

and  Keller  in  1981.  ^"^'^^^^iJ '  „J  Keller  studv  We  were 
replicate  and  update  the  Jol^^son  and  Keller  stuay_ 

collection  was  completed  for  the  P^oj^'^^^^yi^  pi_-/(iata 
for  all  Maryland  school  systems  except  one.  Final  dcta 
collection  was  completed  by  November  1984. 


PURPOSE 


Tha  study's  purpose  was  to  determine  the  present  usage 
and  Keller  study,  data- was  collected  relevant  to  rour  4 

1.  To  what  extent  is  ITV  available  in  the 
Maryland  public  schools? 

2.  To  what  extent  are  teachers  principals 
Ubrary  media  specialists  and  system  ITV 
coordinators  committed  to  the  area  of  ITV. 

3.  To  what  extent  is  ITV  actually  used  in  Maryland 
publ'"''  fcbools? 


4. 


In  general,  what  atticudes  toward  ITV  «^^^J^f.3,3 
by  teachers,  principals,  library  media  specialists, 
and  system  ITV  coordinators? 


1  one  county  (Montgomery)  requested  that  data 
rincipals  and  teachers  be  delayed  until  September  1984.  Data 
oilecVion  from  these  individuals  was  completed  by  late 


P 

c 

November  1934. 
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RELATED  STUDIES 

A  comprehensive  national  study  regarding  the  utiliza- 
tion of  television  in  the  public  schools  was  sponsored  by  the 
Corporation  for  Public  Broadcasting  (CPB)  and  the  National 
Center  for  Educational  Statistics  (NOES)  in  the  1976-1977 
school  year.    The  study  was  directed  by  Peter  Dirr  and  Ron 
Pedone.    The  Dirr  and  Pedone  study  was  representative  of 
12,000  school  systems  and  2,275,000  classrooms.    The  results 
indicated  that  instructional  television  was  used  by  one  out 
of  every  three  teachers  and  that  approximately  fifteen  mil- 
lion students  received  a  regular  portion  of  their  instruction 
via  television.    Whixe  the  results  of  this  study  were  highly 
significant  in  terms  of  national  usage,  it  provided  limited 
benefits  to  assist  in  planning  at  the  state  level. 

In  order  to  provide  more  data  specific  to  the  utili- 
zation of  instructional  television  within  Maryland,  the 
Maryland  State  Department  of  Education,  Division  of  Instruc- 
tional Television,  sponsored  a  Statewide  survey  in  1981.  The 
first  Maryland  ITV  study  was  directed  by  Kerry  Johnson  and 
Paul  Keller  and  was  modeled  after  the  Dirr  and  Pedone  study. 
Like  the  national  study,  the  Johnson  and  Keller  study  col- 
lected survey  data  relevant  to  a^^ailability ,  commitment, 
actual  use,  and  attitudes  toward  ITy.    The  Maryland  study 
utilized  data  collection  questionnaires  which  were  modifica*- 
tions  of  the  instriments  used  in  the  national  study.  Johnson 
and  Keller  found  that  utilization  of  ITV  in  Maryland  closely 
followed  national  trends.    For  example,  they  found  that  ITV 
was  widely  available  5n  Maryland  and  that  42.4%  of  teachers 
used  ITV  in  1981.    Other       idings  indicated  that  ITV  had 
become  an  accepted  feature  jf  instruction  in  Maryland  public 
schools. 

METHOD 

The  present  study  replicated  the  Johnson  and  Keller 
study  in  order  to  assess  the  current  status  of  ITV  utiliza- 
tion in  the  public  schools  of  Maryland  and  to  compare  current 
usage  with  that  of  the  1980-81  school  year.     In  order  to  obtain 
results  which  would  be  comparable  with  the  1981  study,  it  was 
decided  to  design  questionnaires  which  would  closely  follo>/ 
those  of  the  1981  study.    Design  of  the  instruments  followed 
three  principles.     (1)  they  must  closely  match  those  used  in 
the  1981  study  in  order  to  obtain  useful  comparable  results; 
(2)  they  should  include  items  to  collect  data  relevant  to 
current  needs  of  MSDE;   (3)  they  should  be  streamlined  to  ensure 
ease  and  accuracy  of  response.    With  those  in  mind,  we  first 
determined  what  additional  information  was  needed  by  MSDE  and 
by  ourselves  and  then  designed  items  to  collect  such  data. 
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Second    we  reworked  the  instruments  to  ensure  ease  of  response 
and  to  week  out  ambiguous  item.    Effort  was  directed  toward 
decreasingthe  time  Required  to  respond  and  toward  improving 
accuracy  If  response.     Since  the  1981  study  had  not  obtained 
asable  data  from  school  superintendents    it  was  decided  that 
the  instrument  which  had  been  used  in  1981  should  be  rede- 
signed and  sent  to  system  ITV  coordinators.     It  was  felt  that 
?hl  system  coordinators  would  more  likely  be  the  ones  wit n  the 
needed  information  and  that  they  would  be  wi^^^'^f  P^^J^^^?^" 
in  the  study.    The  subsequent  return  rate  among  ITV  coordinators 
(967«)  proved  thes3  assmptions  to  be  true. 

Separate  questionnaires  were  designed  for  teachers , 
library  media  specialists,  principals,  and  ITV  coordinators. 
The  questionnaires  were  organized  around  the  four  "^^JO^  f^^^^ 
questions:    availability  of  ITV.  commitment  to  ITV.  actual  use 
6f  ITV.  and  attitudes  toward  ITV.    The  prototype  questionnaires 
underwent  informal  field  testing  to  identify  P^?blen  it^s  and 
ease  of  response.    After  the  initial  field  testing,  it  was 
decided  to  use  professionally  printed  and  color-coded  question- 
naires that  would  be  attractive  and  easy  Jo  complete.  The 
desi<»n  of  the  questionnaires  was  greatly  helped  by  the  tact 
tnai°?he  instrSments  used  in  the  Johnson  and  Keller  study  were 
suitable  to  be  updated  and  refined. 


SAI4PLE 


s 


The  population  of  this  study  included  all  public 
schools  in  Maryland.    We  were  interested  in  obtaining  results 
which  would  ensure  representation  of  all  systems  and  proper - 
tiiSal  representation  of  elementary,  middle,  and  high  schools 
Consequently,  we  employed  a  variation  of  stratified  random 
s^pt?Srwhich  yielded  a  sample  of  209  Maryland  PubUc  school 
In  each  school  selected,  instruments  were  to  be  completed  by 
tSe  principal,  the  library  media  specialist    and  five  classroom 
teachers,  the  latter  randomly  selected  by  the  prxncipal.  In 
addU?on    the  ITV  coordinated  for  each  public  school  system 
received  an  instrument.    The  final  sample  selected  was  com- 
prised of  24  ITV  coordinators.  209  library  media  specialists, 
and  1.045  teachers. 

ADMINISTRATION 

In  February  of  1984.  a  letter  was  sent  to  each  of  the 
superintendents  in  the  state  explaining  the  purpose  of  the 
study  and  requesting  their  cooperation.    The  collection  of  data 
began  with  the  mailing  of  letters  to  each  school  P^^iU^^P^^  ^^^g 
Aplil  13.  1984,    The  principals'  letters  explained  the  purposes 
of  Lhe  study  and  detailed  procedures  which  were  to  be  fpllo^^^ 
when  the  questionnaires  were  mailed.     Q^estionniare  packets  and 
letters  to  the  209  principals  were  mailed  during  May  2-9, 
E:.ch  packet  sent  to  the  principals  contained  a  principal  s 
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questionnaire,  a  questionnaire  for  the  library  media  specialist, 
and  five  questionnaires  for  classroom  teachers.    The  packet 
included  instructions  for  completing  the  questionnaires  as  well 
as  the  procedure  to  be  followed  in  randomly  selecting  the  class- 
room teachers.    ITV  coordinators  received  questionnaires  and 
letters  of  explanation  the  week  of  May  17,  1984. 

In  order  to  increase  the  response  rate  of  the  study, 
a  follow-up  letter  was  sent  June  5-7,  1984,  to  all  schools 
which  had  not  responded.    A  sample  of  the  follow-up  letter  is 
included  in  Appendix  I.    Telephone  follow-ups  of  those  remaining, 
including  ITV  coordinators,  were  conducted  from  June  6  to  20, 
1984.^ 


THE  DATA 

Data  for  this  study  consists  of  responses  of  a  sample 
of  618  classroom  teachers,  149  library  media  specialists,  166 
school  principals  and  23  system  ITV  coordinators  to  their  respec- 
tive questionnaires. 


tion  were: 


The  results  of  the  questionnaire  mailings  and  collec- 


System  ITV 
Coordinators 

Principals 

Library  Media 
Specialists 

Classroom 
Teachers 

Total 


Questionnaires 
Sent 


24 
209 


Questionnaires 


"09 


1045 
1487 


Returned 

Returned  (%) 

23 

95.8 

166 

79.4 

149 

71.3 

618 

59.1 

956 

64.3 

Analysis  of  the  data  consisted  c  "  categorization  of 
responses  by  elementary,  mid<?le  and  high  school  levels.  Percent- 
ages reponding  in  each  question  ca',egory  by  level  were  calcu- 
lated for  each  £urvey  item. 


^The  schedule  for  Montgomery  County  principals  and 
teachers  was:     - uestionnaire  packet  mailed  -  September  10; 
first  follow-up  -  September  18;  telephone  follow-up  -  November 

5. 
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RESULTS 

The  purpose  of  the  study  was  to  determine  the  present 
usage  of  ITV  in  Maryland  public  schools.    Data  were  collected 
relevant  to  four  major  indices  of  utilization:  availability 
of  ITV,  commitment  to  ITV,  use  of  ITV,  and  attitudes  toward  ITV. 
Data  were  collected  from  four  categories  of  school  personnel: 
teachers,  principals,  school  library  mec*ia  specialists  and 
system  ITV  coordinators. 

AVAILABILITY  OF  ITV 

The  following  results  were  obtained  relevant  to  the 
availability  of  ITV  in  Maryland  public  schools: 

89.0  percent  of  teachers,  98.8  percent  of  school 
library  media  specialists,  93.6  percent  of  principals  and  100 
percent  of  system  ITV  coordinato'.s  reported  that  ITV  program- 
ing was  available  in  their  schools.     ITV  was  most  frequently 
available  via  on-air  direct  broadcast.    Next  in  frequency  was 
cassette-videotape,  cable  TV,  and  closed  circuit  TV.    Less  than 
5  percent  of  schools  reported  having  or  using  videodisc  equipment 

Closely  related  to  the  availability  of  ITV  is  the  avail 
ability  of  television  sets  for  classroom  use.    83.7  percent  of 
teachers  reported  that  it  was  "easy"  or  "pretty  easy"  to  have 
access  to  a  TV  set.    Sets  were  reported  to  be  in  good  repair 
"always"  or  "most  of  the  time"  by  87.8  percent  of  teachers,  92.8 
percent  of  school  library  media  specialists  and  91.9  percent  of 
principals.    The  quality  of  television  reception  was  reported  to 
be  "good"  or  "fair"  by  91.1  percent  of  teachers,  and  by  92.4 
percent  of  principals . 

Sch^dulin^  of  ITV  programs  was  reported  to  be  the  most 
serious  difficulty  in  using  ITV.    When  asked  about  the  degree 
of  difficulty  in  obtaining  a  video  recording  (to  overcome  the 
scheduling  problem),  teachers  responded  as  shown: 

VIDEO  RECORDING  DIFFICULTIES 


Easy  19.0 

Pretty  Easy  24.6 

Sometimes  Can't  9.9 

Not  Easy  8.0 

Never  Tried  26.0 

No  Facilities  11.9 


When  asked  about  the  specific  difficulties  in  using 
ITV,  the  group  surveyed  reported  as  shown: 
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DIFFICULTIES  IN  USING  ITV 


Program  Scheduling  39.9 

Set  Availability  14.8 

Advance  Program  Notice  9.5 

Set  Quality  8.7 

Enough  Planning  Time  6.9 

Set  Maintenance  3 . 9 

Set  in  Class  3.3 

Schedule/Guide  Availability  2.8 

Program  Quality  2.2 

Availability  of  Assistance  1.1 

Others  6.9 


COmiT^ffiNT  TO  ITV 

The  f ollowin%  results  were  obtained  *#^aich  were  rele- 
vant to  the  question    \  tie  extent  to  which  teachers,  principals, 
school  library  media  specialists  and  system  ITV  coordinators 
were  committed  to  the  use  of  ITV. 

..i  indication  of  comriitment  used  in  the  qu^.stionnaire 
was  whethe.'  or  not  schools  had  designated  someone  as  tne  ITV 
coordina-or.    We  found  that  principals  and  teachers  disagreed 
somewhat  or  this  question.    When  we  asked  if  there  was  a  building 
person  res^^cnsible  for  ITV,  the  follc^ing  results  were  obtained: 

BUILDING  ITV  COORDIN\TOR  AVAILABLF 


Teachers  Principals 
Full  Tine             ?.0.4  31.4 
Part  Time            12.8  20.6 
Informal              26.5'  24.5 
None                     40.4  20.8 


Of  those  schools  which  reported  hav?n5  an  ITV  coordin- 
^^"'r,  teachers  reported  that  the  following  services  were  provided: 

•  l\  COORDINATOR  SERVICES 

Teachers 


Distributes  Guides /Schedules  2.6 

Works  with  Students  16.1 

Provides  Training/Consultation  19.4 

Provides  Newsletter  2  8 

Calls  Ar'-^.ntion  to  Program  3b.  ^ 

Provides  Equipment  Assistance  74.2 


Systems  ITV  coordinators  were  asked  to  report  upon  the 
upgrading  or  expansion  o.  ITV  facilities  in  their  respective 
systems.     Coordinators  wert=  asked  what  had  been  done  during  the 
past  thret*  years,  as  well  as  what  was  planned  for  the  next  three 
years.    The  following  data  were  reported 

'  7 
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ITV  FACILITIES  UPGRADING 


Done  in  Planned  for 

Past  3  Years  Next  3  Years 

Increased  the  number  of  TV  sets  46.6  43.4 

Added  Video  Equipme  it  73.9  52.1 

Expanded  Videotape  Libraries  73.9  52.1 

Added  M  ster  Antenna  39.1  30.4 

Added  Production  Equipment  47.8  30.4 

Added  Videodisc  Equipment  0.0  8.7 


USE  OF  ITV 

ihe  study  asked  teachers  to  respond  to  several  item''  in 
order  to  determine  how  and  to  what  extent  ITV  was  used.  Teachers 
reported  that-  they  frequently  view  ITV  as  a  whole  class  (74.9 
percent),  ''At  that  it  is  also  very  common  (77.9  percent)  to  view 
ITV  with  another  class. 

When  acked  how  much  time  they  speud  watching  ITV,  52.8 
percent  of  all  teachers  reported  watching  i\t  least  1/4  hour  of 
ITV  each  week.    58.9  percent  of  elementary,  41.3  percent  of  middle 
and  43.4  percent  of  high  school  teacheri  reported  watching  at 
least  1/4  hours  por  week.    Most  teachers  (87. 6Z)  felt  the  maximtjcm 
appropriate  ti*  ?  for  viewing  ITV  was  between  1/2  hour  and  four 
hours  per  week.    When  tea'ztiers  were  asked  about  student  outcomes 
whi'^.h  thGy  would  attribute  to  ITV,  the  following  results  were 
obtained* 

TEACHERS'  REPORT  OF  OBSERVED  ITV  OUTCOMES 


Expanded  Knowledge  48. 3 

Expanded  Vocabulary  37.7 

Students  Follow-Up  Ideas  45.3 

More  Enthusiastic  About  ScLuol  23.2 

Use  Library  More  17.1 

Watch  More  ITV  at  Home  27.1 

Calming  Effect  46.6 

Others  3 . 9 


When  asked  to  which  types  of  students  ITV  was  most  use- 
ful, teachers  reported  that  ITV  was  most  useful  to  all  students 
(79.0  percent)  rather  than  for  special  abilities  students. 

ATTITUDES  TOWARD  ITV 

Teachers,  pri.       als  and  school  library  media  special- 
ists were  asked  how  :hey  percieved  the  general  attitudes  of 
other  groups  tov^  rd  ITV.    The  following  results  were  obtained: 
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TEACHERS 


Favor  Neutral  Against 

Students                                              68.1  31.7  0.2 

School  Library  Media  Specialists       67.1  32.1  0.8 

Other  Teachers                                    48.5  5C.3  1.2 

SystPTn  Office                                      40.6  57.3  2.1 

Chairs/Subject  Specialists                 39.6  59.7  0.7 

Other  Specialists                               31.2  67.9  0.9 

Parents                                               24.0  70.2  5.8 

SCHOOL  LIBRARY  MEDIA  SPECIALISTS 

Favor  Neutral  Against 

Students                                              68.1  31.7  0.2 

Teachers                                              66.9  32.4  0.7 

Principals                                           61.9  35.1  3.0 

Chairs/Subject  Specialists                 52.2  46.8  1.0 

Other  Specialists                               46.4  53.6  0.0 

Teachers    Organizations                     43.0  57.0  0.0 

Parents                                               25^9  74.1  0.0 

PRINCIPALS 

Favor  Neutral  Against 

School  Library  Media  Specialists       76.0  23.9  0.0 

Teachers                                              63.8  36.2  0.0 

Subject  Specialists                            53.2  46.8  0.0 

Students                                              62.-  37.5  0  0 

Other  Specialists                               43.4  55.8  0.8 

Teachers'  Organizations                      39.8  60.2  0.0 

Paren-s                                               37.0  60.7  2.2 


The  three  groups  generally  view  the  groups  liste>'  as 
being  positive  or  neutral  toward  the  use  of  ITV. 

CONCLUSIONS 

Based  upon  the  results  of  this  study,  the  following  con- 
clusions were  made: 

1.  ITV  continues  to  be  widely  available  in  all  f!ary- 
land  public  sclools.    While  some  differences  in  perception  of 
availability  occurred  between  principals,  teachers,  school 
library  media    pecialists  and  systems  ITV  coordinators,  it  is 
clear  thai.  .-rogr,jming  is  available  to  more  than  90  percent  of  all 
schools.     In  addition,  television  sets  are  available  and  most 
teachers  feel  tnat  it  is  relatively  easy  to  obtain  a  set  for 
classroom  use. 

2.  The  most  serious  problem  related  to  availability 
continues  to  be  scheduling.     Some  hope  to  impro"ing  this  condi- 


ERIC 


469 


9 


tion  lies  in  the  increase  in  the  availability  of  video  record- 
ing equipment  in  individual  schools. 

3.  There  is  a  commitment  to  ITV  as  indicated  by  the 
increase  in  ITV  equipment  and  facilities  during  the  past  three 
years  as  well  as  plans  for  increases  during  the  next  three 
years . 

4.  The  percep  :ion  of  attitudes  tow.  5  ITV  is  generally 
positive.    Teachers,  principals,  and  school  library  media 
specialists  perceive  that  significant  groups  within  the  educa- 
tional environment  are  either  neutral  or  positive  toward  the 
use  of  ITV. 
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Abstract 


FM  radio  in  higher  education  has  been  an  under  appreciated  resource  for 
progranmatic  development  by  sponsoring  inst  *^utions.  Radio,  in  general,  has 
suffered  frora  the  introduction  of  newer  technologies.  The  current  status  of 
noncommercial  radio  has  been  overlooked  by  most  media  researchers.  This 
study  exaoiinos  variables  surrounding  noncommercial  radio  stations  affiliated 
with  colleges  and  universities  as  they  are  in  the  early  1980 's. 
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DESCRIPTIVE  STUDY  OF  NONCOMMERCIAL  FIl  RADIO  STATIONS 
AFFILIATED  WITH  COLLEGES  AND  UNIVERSITIES 


Overview  Perspective 


FM  radio  in  higher  education  has  long  been  the  forgotten  resource  for 
prograinioatic  development  by  sponsoring  institutions.    Radio  has  suffered  from 
the  introduction  of  alternative  technologies  and  the  waivering  of  visible 
support.    The  current  status  of  these  radio  statioT:s  has  been  overlooked  by 
most  media  researchers,  creating  a  oubstantial  void  in  the  available 
descriptive  and  comparative  literature. 

It  is  hard  to  believe,  but  radio  was  originally  noncommercial  aud 
educational.    The  first  radio  station  is  generally  accepted  as  being  KDKA  in 
Pittsburgh,  Pennsylvania,  which  started  regular  broadcasts  in  1920.  Many 
colleges  and  universities,  especially  in  the  midwest,  rushed  to  join  the 
radio  bandwagon  in  the  early  days,  and  have  continued  to  do  so  in  che  post 
World  War  II  era. 

The  com  iexities  involved  with  noncommercial  radio  ^-"f^ration  have  been 
noted  in       .  literature.     Among  these  problems  associate     with  educational 
radio  at  colleges  and  universities  commonly  cited  in  past  studies  include 
lack  of  adequate  oudgets  and  personnel  (Aarnes,  1949;  Halverson,  1947; 
RcShidpour,  1965;  Note  1). 

Any  group  of  organization  thac  has  expanded  as  rapidly  as  has  college 
and  university  radio  cannot  have  done  so  without  some  growing  pains.  Like 
many  such  phenomena,  the  history  of  college  and  university  radio  reflects  a 
multitude  of  developments,  relationships,  and  interdependencies.     It  is 
filled  with  many  successes  as  well  as  failures.    College  and  universicy  radio 
has  never  been  stagnant,  yet  its  path  has  rarely  been  smooth.     It  is 
therefore  necessary  and  helpful  to  conduct  periodic  re-examinations  of  this 
organization.    This  project  presents  various  aspects  of,  and  observations  on, 
the  operation  of  college  and  university  radio  broadcast  facilities. 


The  study  the  investigators  wish  to  report,  serves  to  establish  a 
framework  for  current  and  future  documentation  of  FM  radio  affiliated  wich 
Institutions  of  higher  education.    The  study  examines  the  current  state  of 
college-  and  university-affiliated  noncommercial  FM  radio  stat:'.ons.  The 
research  presents  data  in  that  describes  the  organizational  attribuces  of 
college-  and  university-affiliated  stations  as  it  applies  to  the  foUowini^ 
areas : 

1.  Basic  description  of  institutions  housing  noncommeicial  r^iHlo 
stations 

2.  Operating  budgets 


The  Study 
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3.  Stations  organization  and  personnel,  professional  invoivemeiit , 
technical  support ,  ♦  tudent  ir.volvem^nt 

4.  Station  opeiating  hours 

5.  Station  programming 

6.  Station  philosophies. 

In  this  way  it  is  possible  to  develop  a  description  of  college  and  university 
FM  operations  today. 


Population 

Because  of  the  broadcasting's  movement  toward  general  deregulation, 
coupled  with  the  FCC  edict  banning  10  watt  stations,  it  is  somewhat  difficult 
to  arrive  at  an  exact  count  of  FM  stations  owned  by  colleges  which  are  in 
operation  today- 

The  organization  which  attempts  to  make  accurate  yearly  compilations  of 
radio  and  television  stations  is  Broadcasting  Publications,  Inc.,  which  first 
started  publishing  in  the  1920c.    Their  Broadcasting  Yearbook  points  out  that 
there  are  670  stations  which  are  housed  on  a  college  or  university  campus  or 
are  licensed  to  one. 

After  consulting  with  several  experts  in  the  field  of  educational  radio, 
ic  was  concluded  that  the  best,  most  available  and  authoritative  source  which 
vo  :ld  identify  the  wanted  population  most  accurately  was  indeed  Broadcasting 
^arbook.    Therefore,  a  total  population  was  identified  and  derived  from 
i.iformation  in  the  1982  Broadcasting  Yearbook  that  met  the  following 
criteria:     (1)  that  it  carried  a  noncommercial  designa'uion;  (2)  that  it  was 
either  licensed  to  a  post  high  school  organization  o^,  according  to  its 
address,  was  boused  on  a  college  or  university  campus.     Some  met  all 
criteria,  others  were  licensed  to  a  college  or  university  but  carried  post 
box  number  addresses.     The  working  universal  population  for  this  work  was 
determined  at  570. 


Limitations  and  Assumptions 

LIMITATIONS 

1.     This  study  does  not  explore: 

a.  Station  equipment 

b.  Salaries  paid  personnel 

c.  Physical  size  of  station  and  physical  plant 
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Detailed  lists  of  actual  policies  and  procedures  of  individual 
stations 

e.  Specifics  describing  student  personnel  oS  it  relates  to  academic 
major,  year  in  college,  year  in  college  as  compared  with 
position,  au^  time  actually  spent  working  at  station 

f.  The  personnel  Lection  confines  itself  to  examining  grosL  numbers 
reflecting  those  involved  and  station  groupings 

2.  Due  to  the  size  and  complexity  of  radio  operations  it  is  impossible 
to  collect  all  data  within  the  confines  of  a  fairly  concise 
questionnaire.     To  have  increased  the  size  of  the  questionnaire 
would  have  decreased  the  amount  of  responses. 

3.  There  are  actually  two  distinctive  categories  of  college  and 
university  stations  identifiable  at  the  outset  of  this  study.  NPR 
affiliates  all  meet  certain  specific  minimum  standards  of  personnel, 
operating  times,  budget,  and  operating  power.    The/  are  considered 
together.    The  non-NPR  affiliates  have  no  formal  restrictions  on 
them  as  to  budget,  personnel,  operating  power,  and  broadcasting 
times.    These  stations  are  considered  statistically  in  one  category 
and  two  subcategories:     10  watt  stations  (lOWS)  and  stations  whose 
operating  power  is  greater  than  10  watts  (GrlOWS). 

DISTRIBUTION  OF  THE  INSTRUMENT 

After  a  pilot  study  was  conducted  at  the  1982  Broadcast  Education 
Association  Annual  Convention  and  refinements  were  made,  the  survey  was  sent 
out  in  April,  1982  and  seven  weeks  was  allowed  for  responses. 

The  survey  was  sent  to  670  college  and  university  stations  throughout 
the  United  States.    Of  the  670  sent  out,  268  (40%)  were  returned.    Of  these. 
243  (90.7%)  were  completed  adequately.    The  information  contained  was  en'  '  '  d 
into  a  Honeywell  L<;vel  66  Computer  housed  on  the  campus  of  Indiana  Univei 
of  Pennsylvania  (lUP)  for  analyses  utilizing  the  SPSS  program  which  generated 
descriptive  data  as  they  related  to  mean,  median,  mode,  and  range  of  specific 
items  and  sections  (see  Leidraan  &  Lamberski,  1986  for  a  deta'.l  methodology 
presenta^^lon). 


The  all  inclusive  findings  of  the  survey  are  too  lengthy  to  fully  report 
within  the  confines  of  this  particular  discussion  (see  Leidman,  1985). 
However,  some  of  tl«e  major  areas  of  interest  including  financing,  technical 
personnel,  staffing  operating  hours,  and  progranming  are  discussed  herein. 

All  statistics  and  descriptions  contained  here  have  been  derived  from 
the  243  completed  questionnaires.    NPR  responses  equaled  51.    They  reprrsent 


Findings  and  Conclusions 


ERIC 


4  of  12 


7-9%  of  the  population  and  21%  of  the  replies.    Non-NPR  stations  partici- 
pating numbered  192,  or  28. 65%,  of  the  population,  or  79%  of  the  responde.iCS. 
Of  the  192  non-NPR  stations,  42  were  10  watt  stations.    They  represent  6.27% 
of  the  population,  17.28%  of  those  replying,  and  23%  of  the  non-NPR  stations 
participating  1*^  th^.s  study.     Non-NPR  stations  with  power  greater  than  10 
watts  numbered  150  representing  22.38%  of  the  population  and  61.72%  of  the 
respondents,  and  78%  of  non-NPR  stations  participating  in  this  study. 

Both  tiie  10  watt  stations  as  well  as  those  with  powf»r  greater  than  '0 
watts  are  included  in  the  general  category  of  non-NPR  stations  as  well  as  the 
component  parts. 

In  summary J  for  the  purposes  of  this  section,  the  following  will  equal 
the  relative  freque..         (percentages)  of  100%: 


N  =  243~A11  stations 

N  =  51— NPR  stations 

N  =  192~A11  non-NPR  stations 

N  =  150 — Non-NPR  stations  with  power  gteater  than  10  watts 
N  ^  4?— Kon-NPR  10  watt  stations 


COLLEGE  AND  UNIVERSITY  FINANCING— SUMMARY 

This  section  examined  the  gross  amount  of  money  reported  by  the  219 
stations  responding  co  this  section.     It  also  considered  the  sources  of 
station  funding  and  the  percentages  derived  from  specific  sources. 

A  limitation  to  this  section  concerned  itself  with  how  stations 
interpreted  what  "operating  budget"  involved.    There  is  some  question  as  to 
whether  o'.  not  managers  included  such  line  items  as  student  Federal  Work 
Study  money,  release  time  salai y  equivalent  for  professionals,  and  standing 
costs  such  as  rent,  electricity,  etc* 

The  total  amount  reported  by  the  college  and  university  stations 
responding  to  the  item  regarding  operating  budgets  was  $22,383,990.  The 
range  was  from  $600  to  $1.5  million  with  the  average  for  NPR  standing  at 
$345,228,  for  GrlOWS  at  $42,462,  and  for  lOWS  at  $10,649. 

Although  stations  tend  to  receive  funding  from  any  number  of  different 
sources,  wher  examining  this  variable  as  a  whole,  indications  are  that  less 
th^ip  50%  rf  ej  ve  any  substantial  amount  from  any  particular  source  with  the 
exception  of  NPR  and  their  receiving  50%  of  funding  from  general  college 


Findings  indicate  that  with  the  exceptions  of  donations  and  grants, 
college  and  university  station  groupings  receive  some  of  their  financing  from 
a  combination  of  the  following  sources.    These  include:     general  collage 
funds,  funds  administered  by  a  particular  school  or  department,  student  funds 


funds. 
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(activity  fees,  etc.),  and  other  sources  such  as  underwriters.    Though  a 
category  for  endowme»iL  was  included  in  the  original  list  of  possible  funding 
sources  only  two  schools  received  any  funding  in  this  way. 

NPR-af filiated  stations  reported  receiving  smaller  amounts  of  monies 
from  schools,  departments  and  student  funds  than  do  the  non-NPR  group.  This 
is  also  true  of 

student  funds.    However,  they  do  receive  more  of  their  funding  from  grants 
and  donations.     Only  8%  of  the  non-NPR  stations  receive  grant  money  and  40*^ 
receive  donations.    However,  74%  and  85%  of  the  NPR  stations  receive  these 
funds,  respectively. 

Almost  50%  of  the  non-NPR  stations  derive  an  average  of  77%  of  their 
funding  from  student-generated  funds  vs.  only  about  66%  of  the  NPR  stations 
that  do  so. 

While  83%  of  the  NPR  stations  receive  about  50%  of  their  monies  from 
general  operating  funds,  47%  of  the  nonrNPR  facilities  receive  money  in  this 
way.    However,  the  amount  of  this  funding  for  those  non-NPR  stations  averages 
67%. 

VJhile  almost  27%  of  non-NPR  stations  report  receiving  6%  of  their 
funding  from  funds  administered  by  specific  schools  or  departments,  only  14% 
of  the  NPR  affiliates  do  so.    These  stations  receive  approximately  one-half 
of  their  funding  in  this  way. 

Other  sources  of  income  such  as  underwriters  were  reported  by  80 
stations  (36.5%).    When  breaking  down  recipients,  one  observes  that  35 
(74.5%)  of  the  NPR  stations  receive  "other"  funding  as  compared  with  45 
(26.1 %)  of  those  who  are  not.     Somewhat  surprisingly,  the  10  watt  stations 
reported  the  highest  mean  percentage  in  this  category,  however,  only  six  10 
watt  stations  total  reported  funding  of  this  type.    Also,  the  10  watt 
stations  showed  a  considerable  number  (23)  receiving  a  majority  (78%)  of 
their  funding  from  student  funds. 

It  is  important  to  note  that  most  stations  (approximately  85%)  received 
funding  from  at  least  two  sources.     None  received  funding  from  all  sources. 

STATION  FUNDING—CONCLUSION 

Although  percentages  can  be  deceiving,  dollar  amounts  are  real. 
Ther  ^fr^re,  even  though  r  10  watt  station  might  receive  100%  of  its  operating 
budget      rough  underwriters,  this  amount  might  only  be  $1,000.     In  the 
interest  of  greater  participation,  this  study  chose  not  to  delve  into  the 
exact  dollar  amounts  generated  by  particular  sources.    However,  certain 
things  are  evident. 

A  higher  percentage  of  NPR  stations  receive  a  greater  amount  of  their 
money  from  general  college  funds.    The  non-NPR  stations  show  a  closer  fiscal 
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relationship  to  school  jr  department  funds^    That  this  is  so  would  seem  to 
emphasize  the  fact  that  colleges  and  universities  provide  a  substantial 
amount  of  backing  to  high  expense  NPR  operations.    Furthermore,  schools  and 
departments  hold  the  purse  strings  for  many  of  the  other  stations.    This  can 
be  interpreted  to  mean  that  closer  academic  and  educational  ties  exist 
between  the  non-NPR  stations  and  curriculum. 

The  actual  range  of  operating  budgets  is  in  itself  somewhat  astounding. 
To  ever  begin  to  compare  a  facility  that  subsists  on  $600  per  year  with  one 
that  has  the  resources  of  $1.5  million  can  provide  seems  ludicrous.    Yet  both 
of  these  facilities  work  under  the  same  set  of  FCC  guidelines. 

Although  it  is  understood  that  NPR  stations  must  have  a  minimum  budget 
of  $100,000  per  year  in  order  to  remain  affilia*-ed,  the  fact  that  their 
averige  budget  is  $345,000  is  indicative  of  the  kind  of  support  these 
stations  receive.    Comparing  this  with  the  average  10  watt  station  with  a 
budget  of  some  $10,000  cannot  help  but  lead  one  to  certain  conclusions  about 
availability  of  resources,  equipment,  and  persomic'.    NPR  stations  have  all 
three. 

It  can  M  argued  that  institutions  which  heavily  fund  NPR  stations  do  so 
out  of  a  sen.  ^  of  mission  related  to  coumunity  service.    Yet,  the  10  watt 
stations  also  supply  such  seivice,  or  at  least  try  to  do  so. 

la  th€:  world  of  college  anJ  university  radio  there  are  stations  with 
greater  than  10  watts  of  power  that  have  substantial  operating  budgets.  The 
$42,000  average  reported  by  these  stations  carries  with  it  availability  of 
broadcasting  resources.    Yet,  the  mode  and  median  of  $20,000  are  probably 
more  accurate  in  this  case.    At  least  in  terms  of  finances,  it  c^:*^  be 
concluded  that  the  larger  non-NPR  stations  are  viable. 

Finally,  it  would  appear  that  college  and  university  stations  do  receive 
at  least  some  money  from  a  variety  of  different  sources.    They  take  it  where 
it  can  be  found.    The  level  of  commitment  toward  college  and  university 
radio,  based  on  interest  and  availability  of  funds,  varies  from  institution 
to  institution.    The  fact  remaiis,  however,  that  college  and  university 
stations  do  receive  money. 


TECHNICAL  HELP-- SUMMARY 

Of  98%,  or  239  stations  reporting,  197  (43%)  reported  having  full-time 
technicians  vs.  132  (55%)  which  h  \  s-nae  type  of  part-time  technical  help. 
Of  NPR  stations,  88%  had  full-time  technicians  as  compared  with  33%  tor  the 
non-NPR  stations.     0  Jy  16.7  (7)  10  watt  stations  reported  employing  a 
full-time  technician.    Furthermore,  229  (96%)  of  all  stations  answered  that 
they  d      nave  access  to  someone  with  a  First  Class  FCC  license. 
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TECHNICAL  HELP— CONCLUSION 

Once  again,  it  appears  that  10  watt  stations  are  definitely  on  the 
bottom  of  the  college  and  university  radio  pile.    Their  lack  of  full-time 
technical  help  is  evident.    This  is  just  another  indication  of  the  problems 
confronting  such  operations.     NPR  stations  are  well  established  in  this  area 
and  GrlOWs,  although  not  having  complete  technical  help,  at  least  show  that 
there  is  some  attention  being  paid  to  this  phase  of  operations. 

ACTUAL  STAFFING  OF  THE  COLLEGE  AND  UNIVERSITY  STATION 

There  were  several  areas  of  staffing  analyzed  by  this  research.  They 
ranged  from  staff  totals  and  students  involved  in  station  operations  to  which 
students  were  paid,  received  academic  credit,  or  were  volunteers. 

The  gross  number  of  individuals  involved  in  the  operations  of  the  236 
stations  reporting  totaled  11,886.    Of  these,  1,388  were  associated  with  NPR 
stations  as  compare  with  10,498  for  the  non-NPR.     Furthermore,  the  average 
for  the  non-NPR  station  was  much  higher,  56  people  vs.  29  for  the  NPR 
stations* 

Stations  definitively  reporting  student  involvement  (SRSI)  numbered  225. 
This  measurement  shows  some  9,540  students  involved.     In  NPR  stations  there 
were  767  vs.  8,772  in  non-NPR  stations.    The  percentages  of  student  involve- 
ment are  much  higher  in  non-NPR  stations  than  in  NPR  stations.  Also, 
indications  that  10  watt  stations  are  the  most  dependent  on  student  help  is 
apparent. 

STAFFING  CONCLUSION 

Volunteerism  seems  to  be  a  backbone  of  non-NPR  stations.    Most  (88%)  of 
the  people  involved  receive  no  remuneration.    This  is  to  be  expected  within 
an  educational  setting,  yet  the  dependence  of  any  organization  on  such  a  high 
level  of  young  volunteers  cannot  help  but  have  a  marked  effect  on  the  organi- 
zation' s  performance. 

College  and  university  radio  stations  strive  for  a  competitive 
"professional"  sound.    However,  indications  are  that  realization  of  this  goal 
is  made  more  difficult  because  of  staffing  patterns. 


COLLEGE  AND  UNIVERSITY  OPERATING  HOURS—SUMMARY 

Col]ege  and  university  stations  generally  broadcast  for  long  hours 
during  the  academic  year.     NPR  stations,  bound  by  contractual  agreement  with 
a  network  average  between  18  ar»^  21  hours  per  day  (hpd)  year  round.  The 
findings  bear  this  out.    This        not  the  case  with  non-NPR  college  and 
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university  stations.    Two  hundred  and  forty-one  stations  reported  on 
operating  hours. 

There  is  a  change  apparent  in  operating  hours  among  nor-NPR  stations. 
While  they  average  18  hours  per  day  during  weekdays  when  classes  are  in 
session,  the  mode  reflects  an  actual  increase  of  stations  broadcasting  around 
the  clock  on  weekends,  40  stations  for  weekday  operations  versus  48  stations 
on  weekends.    However,  the  actual  average  decreanes  by  approximately  1  hpd. 

Non-NPR  stations  show  some  tendency  to  close  down  in  the  sutnner  months. 
Sixteen  (9%)  of  the  GrlOWS  do  so  as  compared  with  48%  (20)  of  the  10  watt 
stations.     However,  those  remaining  on  the  air  average  about  16  hpd. 

During  winter  and  spring  recesses  the  non-NPR  stations  also  close  down 
at  an  even  higher  rate  than  they  do  in  the  suiiiner.    Thirty-eight  percent  of 
the  10  watt  stations  cease  operations  and  33  (22%)  of  the  GrlOWS  do  so. 
However,  those  continuing  operating  average  close  to  18  hpd* 

OPERATING  HOURS— CONCLUSION 

If  broadcast  hours  can  in  some  way  be  equated  with  level  of  commitment 
to  community  service  and  professionalism,  it  might  be  concluded  that  at  least 
during  the  months  when  school  is  in  session  all  college  and  university 
stations  show  a  high  degree  of  both. 

NPR  operations  are  not  an  issue  here.    They  operate  7>65  days  per  year. 
The  consistency  with  which  the  non-NPR  stations  broadcast  reflect  an 
essential  difference  between  them  and  the  NPR  group.    Either  through  choice 
or  necessity  born  of  inadequacies  of  whatever  sort  many  average  college  and 
university  stations  leave  the  airwavco  when  school  closes.    This  fact  can 
lead  one  to  the  conclusion  that  such  stations  have  yet  to  completely  come  of 
age  in  regard  to  realization  of  fully  professional  schedules. 

PkOG  RAMMING— SUMMARY 

College  anH  university  radio  programming  is  not  standardized.    There  ^s 
a  wide  range  of  programming  types  to  be  heard  throughout  the  cross  section  of 
American  college  stations. 

Of  229  respondents,  179  (78%)  reported  that  they  did  have  a  specific 
sound  or  fomiat.    These  covered  the  range  of  music  from  jazz  to  AOR  to  free 
form  to  fine  arts. 

Unlike  past  studies,  this  one  found  that  although  classical  music  is 
still  carried  by  many  (167)  college  and  university  stations,  jazz,  with  170, 
has  surpassed  it  in  popularity.    However,  in  terms  of  gross  hours  per  week 
(hpw),  indications  are  that  rock  supersedes  both  jazz  and  classical.  Yet, 
the  broadcasting  of  rock  was  reported  by  only  147  stations  as  compared  with 
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classical  and  jazz.     Indications  are  that  those  stations  which  do  air  rock 
devote  a  great  deal  of  time  to  it.    For  the  pur;  jses  of  this  sunmary  all  rock 
types  have  been  grouped  together,  although  within  the  study  rock  subgroups 
such  as  Progressive,  \0R,  Heavy  Metal,  NewWave,  Punk,  Retrospective,  and 
Top  40  were  examined.    Very  few  (10)  NPR  stations  broadcast  any  rock.  This 
represents  only  21%  as  compared  with  78%  of  the  non-NPR  stations.    No  NPR 
station  reported  playing  any  heavy  metal  or  punk  rock. 

Other  types  of  music  on  college  and  university  airwaves  include  blues, 
country  and  western,  bluegrass,  Broadway,  MOR,  adult  contemporary.  Christian 
religious,  reggae,  and  urban  contemporary.    With  the  exc<jptions  of  MOR-adult 
contemporary  and  Chriscian  religious,  the  other  types  of  music  average  under 
10  hpw  in  each  category  throughout  the  station  subgrouping  types. 

The  MOR-adult  contemporary  statistics  indicate  that  although 
comparatively  few  (49)  play  this  music,  those  that  do  average  between  19  and 
28  hpd  with  an  overall  mean  of  26  hpw.    The  10  watt  stations  play  the  least. 

Only  or.^  NPR  station  reported  broadcasting  any  Christian  religious 
music.     Sixty-three  of  the  non-NPR  stations  do  so  aver^?i*.^  24  hpw  with  a 
range  from  1  to  168  hpw.     This  indicates  that  wholly  Christian  religious 
college  and  unive'"sity  stations  exist.     Format  types  reported  support  this 
indication. 

In  regard  to  news-public  affairs  programming,  208  (93^7%)  of  all 
stations  air  such  programming  In  varying  amounts  ranging  froni  an  average  10 
hpw  for  lO  watt  stations  to  12  bpw  for  larger  non-NPR  suatlons  to  30  for  NPR 
affiliates.     Included  in  this  category  are  news,  sports,  public  affairs,  and 
talk. 

Some  type  of  specific  news  was  reported  as  being  broadcast  by  17 
(80.6%)  of  the  respondents.     NPR  stations  were  again  first  with  an  average  of 
22  hpw  for  41  (87.2%)  of  their  affiliates  as  compared  with  6  hpw  for  the  138 
(79%)  for  the  non-N?R  stations.    The  other  subcategories  of  new-public 
affairs  were  similarly  weighted. 

PROGRAMMING—CONCLUSION 

It  Is  evident  from  the  findings  of  this  study  fiat  substantial  changes 
within  the  realm  of  college  and  university  program  fare  have  taken  place. 
However,  it  would  be  irresponsible  and  inaccurate  to  draw  universal 
conclusions  to  an  absolute  nature.    These  findings  may  be  judged  to  be 
Indicative  rather  than  chiseled  in  marble. 

It  would  appear  that  college  and  university  stations  in  their 
programing  are  moving  away  fror:  their  traditional  role  as  the  bastion  --i 
preservation  of  classical  music.     Programming  is  much  more  mainstreamed,  and 
so  broadens  the  base  of  appeal,  not  only  for  the  listener  but  also  for  those 
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Involved  with  the  actual  broadcasting.     In  the  case  of  most  non-NPR  stations 
this  means  that  students,  like  most  young  adults,  exhibit  taste  in  music 
which  reflects  the  times.    For  the  early  1980s,  the  most  popular  genre  of 
music  heard  on  the  air  is  some  type  of  rock.    This  thought  is  easily 
supported  by  turning  the  radio  dial  down  its  length  as  well  as  checking 
best-selling  record  lists  in  Billboard,  Variety,  etc. 

The  rock  element  is  undeniable.     Several  college  and  university  stations 
are  solely  rock-oriented  in  content.    This  development  represents  a  great 
change  from  previous  times.    The  trend  will  most  likely  continue  but  probably 
never  totally  dominate  tho  college  and  university  radio  scene.    Current  music 
will  always  be  available  through  commercial  outlets.    This  may  not  be  true 
for  either  jazz  or  classical. 

The  upsurgence  or  jazz  may  be  judged  as  resulting  from  a  search  for  the 
least  offensive  common  denominator.    Very  few  people  are  offended  by  jazz^ 
Many  are  devotees.     But  jazz  commercial  stations  have  yet  to  appear  in  any 
numbers,  therefore,  jazz  on  noncommercial  radio  offers  a  real  alternative. 

Young  adults  prefer  to  listen  and  broadcast  their  own  type  of  music,  but 
jazz  proves  to  be  a  palatable  alternative  for  them  as  well.     Classical  music 
listeners  generally  find  jazz  appealing.     Supporting  this  view  is  the  fact 
that  the  classical  music  commercial  station  WGMS-FM,  Washington,  D.C., 
features  jazz  every  Saturday  evening.    The  prograji  is  very  well-received  by 
its  listeners. 

Thus,  for  the  collt^ge  and  university  sta*  ion  in  quest  of  a  compromise, 
jazz  works.     NPR  stations  continue  to  carry  a  lot  of  classical  music  but 
Lhey,  too,  have  jazz. 

Those  stations  which  air  Christian-religious  or  Christian-contemporary 
music  are,  in  all  cases,  connected  with  a  religiously-based  institution. 
This  interdependence  is  not  only  absolute  but  it  is  also  exclusionary.  If 
such  institutions  continue  to  find  that  it  is  in  their  interest  and  that  of 
their  select  listenership  to  broadcast  this  type  of  programming,  they  will  do 
so  and  will  remain  a  minority  factor  in  the  college  radio  picture. 

The  seeming  lack  of  news-public  affairs-oriented  programming  is 
apparent.     Does  noncommercial  college  and  university  radio  operate  in  the 
public  interest?    Whatever  one's  particular  interpretation  of  same,  the 
answer  cannot  be  final. 

That  sector  of  college  and  university  radio  which  has  the  greatest 
resources  produces  the  most  public  affairs-news  programming.     NPR  stations 
cover  the  Issues  and  looks  at  the  world  more  than  most. 

It  is  easy  to  criticize  non-NPR  college  and  university  stations  for  not 
airing  more  news  and  public  affairs.     It  is  also  easy  to  accuse  these 
facilities  of  not  operating  in  the  public  interest.    Yet,  without  adequate 
backing  and  resources,  realization  of  this  directed  charge  becomes  very 
difficult ,  if  not  impossible. 


ERLC 


11  of  12 


College  and  university  programming  has  undergone  changes.  Tii'^^re 
continue  to  be  many  stations  using  a  block  programming  technique  which  tries 
to  appeal  to  many  audiences  but  there  are  also  many  which  commit  themselves 
to  a  specific  format. 

One  basic  question  that  remains        *"^at  concerning  Itself  with 
mainstreaming  noncommercial  radio.     Is  good  idea  to  have  this  sector  of 

radio  also  appeal  to  the  majority  or  sh'    -a  college  and  university  radio 
still  cater  to  the  minority  audience  of  its  traditional  appeal?    The  question 
has  no  single  answer  and  this  study  would  indicate  that  college  radio  itself 
has  yet  to  decide  in  a  unified  fashion. 


While  in  the  course  of  this  study  certain  other  related  projects  which 
could  be  of  use  to  the  field  of  college-and  university-affiliated  radio 
became  apparent. 

Some  '^ire  listed  Selow: 

1.  To  survey  the  10  watt  stations  existing  in  1983  and  ascertain  how 
many  made  the  transition,   joined  cable  systems,  or  ceased  operation 
altogether 

2.  To  examine  overall  college  operating  budgets  and  learn  what  per- 
centage is  appropriated  to  FM  radio  operations 

3.  A  study  to  ascertain  the  following:    Do  college  and  university 
stations  feel  the  need  to  compete  with  commercial  stations?  Do 
they  now  program  in  this  direction? 

Certain  oth^r  interesting  trends  also  surfaced.    One  in  particular  deal*, 
with  the  basic  character  of  noncommercial  radio,  specifically  the  amount  of 
rock  and  roll  of  all  types  currently  being  broadcast. 

If  the  statistics  of  this  study  are  truly  indicative  then  they  show  a 
kind  of  "loss  of  identity"  for  traditional  college  and  university  stations. 
Furthermore,  it  would  seem  that  such  facilities  are  programming  competitively 
with  commercial  stations.     It  is  possible  that  this  will  be  the  direction  in 
the  future  for  all  but  those  select  few  NPR  stations. 

Another  disturbing  result  of  the  programming  reported  by  college  and 
university  stations  concerned  the  small  amounts  of  news-public  affairs 
programming  produced.     Granted  that  such  programming  is  difficult  to  crcrte 
and  rustain  at  a  high  level.    However,  the  entertainment-oriented  rad-'o  jhich 
was  reported  by  most  stations  comprises  only  part  of  the  mission  orl;^. inaliy 
set  forth  by  the  FCC  when  noncommercial  radio  was  created. 
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It  seems  that  the  issues  surrounding  college  and  university  stations  as 
training  grounds  for  future  broadcasters  and  the  predominance  of  rock  on  many 
stations  cause  a  conflict  of  purpose.    If  an  ultimate  mission  of  a  college 
and  university  station  is  to  compete  and  train  competitors  for  the  world  of 
broadcasting,  does  it  not  seem  that  many  are  losing  an  excellent  opportunity 
to  improve  the  caliber  of  offerings  on  the  airwaves  not  only  for  the  present 
but  for  the  future  as  well.    Yet  there  is  no  question  that  college-  and 
university-affiliated  radio  is  a  viable,  dynamic  entity  in  the  broadcasting 
picture  today. 
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A  METH0D0L03Y  IN  STUDYING  NONCtMIERCIAL       IMDIO  STATIONS  ~  A  CASE  STUDY 


Th«  purpose  O'f  this  undtrtaking  wis  to  txmint  tht  stitt  O'f  collegt-  and 
un  iversi  ty-a'f'f  i  1  iatfd  noncormtrcial  FM  radio  as  it  was  today  in  tht 
»ar1x'-!980^s.    This  w«.s  dont  by  "first  txainining  tht  littraturt  surrounding  tht 
background  oi  noncommtrcial  radio  in  order  to  d^vtlop  a  survty  framework  within 
which  to  work.    The  second  and  more  immediate  phase  of  this  project  involved 
securing  data  concerning  certain  phases  of  college  and  university  radio 
operation  and  as  a  result  gather  new  and  up-to-date  information  relative  xo 
these  organizations. 

This  research  was  national  in  scope.    It  was,  thereforey  necessary  to 
construct  a  questionnaire  and  distribute  it  to  all  college  and  university 
stations  nationwide  which  were  identifiable  through  the  1?82  Broadcast i no 
Yearbook.    In  order  to  construct  the  seven-part  questionnaire!  an  examination  of 
needed  information  relative  to  noncommercial  FM  college  and  university  radio  was 
made.    Additional  inforination  was  gathe>^ed  by  interviews  with  people  involved  in 
the  field.    B?fore  actually  sending  the  questionnaire,  it  was  examined  and 
commented  upon  by  a  committee  of  noted  researchers,  sociologists  involved  in 
this  type  of  research,  and  two  noted  broadcast  educators.    A  pilot  study  was 
conducted  at  the  1983  BEA  convention  with  follow-up  among  the  participants. 

Comments  and  criticisms  of  the  instrument  are  presented  in  this  paper 
along  with  the  major  findings. 
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A  METHODOLOGY  IN  STUDYING  NONCOMMERCIAL  FM  RADIO  STATIONS  ~  A  CASE  STUDY 


Noncommercial  FM  tducaiional  radio  is  a  huge  animal  that  exists  in  a  world 
that  does  not  really  understand  it. 

All  radio  stations,  or  for  that  matter,  any  mass  media  operation,  represent 
an  extremely  complex  set  oi  interrelationships  using  technology,  talent,  and 
human  relationships.    In  order  for  any  broadcast  station  to  function 
effectively,  it  develops  its  own  superstructure.    Yet,  college  and  university 
stations  must  operate  within  a  larger  superstructure. 

There  is  a  constant  need  to  update  the  data  in  this  area  and  yet,  as  the 
literature  shows,  this  is  not  done  regularly.    The  annual  National  Public  Radio 
—  Corporation  for  Public  Broadcasting  reports  only  deal  with  their  own,  not 
with  the  whole  college  and  university  radio  scene,  as  do  other  organizations 
such  as  the  Broadcast  Education  Association. 

Research  has  never  had  an  important  place  in  educational  broadcasting. 
Very  little  has  been  done  on  educational  broadcast  facilities.    This  fact  was 
examined  by  Avery  (1978)  who  concluded  that  more  research  was  needed  to  be  done 
by  academicians  and  broadcast  research  should  be  stressed  in  undergraduate 
curriculum. 

Twenty  years  ago,  the  National  Association  of  Educational  Broadcasters 
conducted  a  thorough  study  of  educational  radio  under  the  auspices  of  the  Ford 
Foundation.    Their  published.  The  Hidden  Medium,  examined  the  then  current  state 
of  noncommer ical  radio. 

At  approximately  the  same  time,  Rashidpour  (1965)  surveyed  educational 
radio  stations.    Iwo  problems  emerged!    lack  of  money  and  lack  of  personnel. 

Presently,  there  is  a  great  dea'i  of  information  available  about  college  and 
university  noncommercial  stations  affiliated  with  NPR.    However,  there  is  a 
dearth  of  material  on  nonaff II iates.    It  would  be  useful  to  make  some  attempt  to 
help  remedy  this  situation.    Unfortunately,  the  Broadcast  Education  Association 
(BEA)  only  keeps  accurate  records  of  its  own  membership.    AHhough  excellent,  It 
is  not  nearly  complete  (Caldwell  &  Niven,  1981). 

Based  on  the  aforementioned  studies,  it  would  appear  that  the  area  dealing 
with  college-  and  university-affiliated  FM  noncommercial  radio  is  one  that  \^ 
always  ripe  for  additional  research.    The  field  is  always  changing  and 
enlarging.    It  is,  in  a  word,  dynarriic. 

Managing  a  college  or  university  station  is  difficult.    Most  people 
involved  have  little  or  no  formal  background  in  management.    New  data  for 
reference's  purpose  would  also  be  helpful  to  aid  in  planning  for  the  future. 


The  Purpose 

The  purpose  of  this  paper  is  to  present  a  methodological  approach  and 
resultant  findings  revealing  the  current  state  of  college-  and 
university-affiliated  noncommercial  FM  radio  in  the  United  States. 

The  following  areas  of  college  and  university  radio  were  studied: 

A.    Basic  description  of  the  station  as  it  pertains  to  enrollment  of  the 
institution  housing  the  station,  station  operating  power,  licersee,  age,  number 
of  other  FM  stations  in  the  area;  organi:?ational  memberships  of  the  station,  and 
un  i  t  af f i 1  i at  ion; 

2.    Station  funding  as  it  pertains  to  operating  budget  and  percentage 
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sources  of  the  funding; 

3.  Organization  and  structure; 

4.  Personnel  as  it  pertains  to  managers  of  college  and  university 
stations,  technicians  who  maintain  equipmenty  and  overall  prof essi onal ,  as  well 
aS|  student  staffing  of  facilities  in  terms  of  gross  number; 

5.  Operating  hours  as  it  pertains  to  length  of  tirie  college  and  university 
stations  broadcast  during  various  times  of  the  year; 

6.  Programming  as  it  pertains  to  specific  formats  reported,  what  is 
actually  broadcast,  availability  of  satellite  technology;  and 

7.  Station  philosophy  as  it  pertains  to  college  and  university  operations 
in  general . 


Before  constructing  the  questionnaire,  other  area-related  instruments, 
including  the  NAEB  instruments  were  reviewed«    Interviews  and  discussions  were 
also  conducted  with  various  professionals  in  educational  radio  and  sociology  to 
make  sure  that  the  appropriate  areas  would  be  included  for  consideration.  A 
preliminary  questionnaire  was  developed  and  subfPitted  to  Uilliam  McCavitt  of 
Indiana  University  of  Pennsylvania  and  also  to  a  noted  educational  broadcaster, 
John  M.  Kittross  of  Temple  University,  as  well  as  Donald  Lueder  and  Uillard 
Clouse  of  k/anderbilt  University.    Returned  suggestions  lead  to  a  refining  of  th^ 
questionnaire. 

A  pilot  study  of  this  survey  took  place  at  the  1982  Annual  Meeting  of  the 
Broadcast  Education  Association.    Twenty  college  and  university  managers  were 
present.    Follow-up  interviews  took  place  and  focused  upon  critism  of  the 
instrument  in  order  to  more  fully  refine  the  final  questionnaire.    A  copy  of  the 
final  questionnaire  has  been  attached  to  this  paper. 

The  questionnaire  would  be  sent  to  all   identified  college  and  university 
stations  increasing  the  probability  of  response  and  ultimately  the  confidence  in 
results.    Mailing  to  all  identified  stations  also  avoided  possible  sampling 
errors  brought  about  by  arbitrary  sampling  procedures.    Simply,  this  survey 
research  is  treated  as  a  descriptive  study  meant  to  "discover  the  distribution 
of  certain  traits  or  attributes'  (Babbie,  1973,  p.  58)  of  college  FM  radio.  No 
value  Judgements  are  involved,  only  observations  and  summations. 

The  final  questionnaire  was  printed  and  mailed  to  general  managers  of  all 
noncommercial  FM  radio  stations  affiliated  with  colleges  and  universities  in  the 
50  United  States.    They  were  asked  to  return  the  questionnaire  within  seven 
weeks.    The  population  to  receive  the  mailed  questionnaire  consisted  of  all 
floncommer ical  college  and  university  stations  as  identified  in  Broadcast i no 
Yearbook  (1982)  (N=670). 

A  self-addressed,  stamped  envelope  was  included  to  encourage  participation. 
An  introductory  letter  stated  the  purpose  of  the  survey  and  the  promise  of  a 
report  upon  completion  of  this  project. 

Two  consent  forms  were  also  included.    The  first  form  granted  permission  to 
use  any  and  all   information  provided  within  the  narrative  portion  of  the 
findings.    The  other  consent  form  assured  confidential  use  of  m?^terial  for 
statistical  compilation  purposes  only. 

Explanation  of  the  Questionnaire 

The  purpose  of  the  questionnaire  was  to  gather  data  on  college-  and 
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uniMer»lty-aff il iated  FM  radio  operations  as  stattd  in  the  purpose.    The  results 
were  used  in  descriptiue  data  analyses.    As  indicated,  questions  formi/lated  were 
goMerned  by  the  desired  resea^^ch  questions  and  refined  through  extremely 
internal  peer  reviei^. 

Internal  and  external  validity  oi  the  questionnaire  was  controlled  in  pat^t 
by  extensive  professional  reviews  and  through  a  controlled  pilot  test. 
Subsequent  instrument  revisions  allowed  for  a  strategy  of  open  ended  statements 
supported  by  an  elaborate  system  of  data  encoding. 

The  instrument  included  six  basic  areas  which,  after  the  data  was  compiledi 
to  provide  an  accurate  description  of  the  college  and  university  radio  stations. 
Th»  questionnaire  can  be  found  in  Appendix. 

The  term  Faculty-Advisor-Manager  (RAM)  has  been  developed  in  order  to  cover 
all  possible  Jurisdictions.    This  person  may  or  may  not  be  a  member  of  college 
faculty.    He  or  she  may  be  a  faculty  advisor  or  a  faculty  manager  or  perhaps 
Just  a  manager,  or  even  a  student  manager.    It  was  requested  that  the  chief 
executive  (FAM)  of  the  station  fill  out  the  questionnaire. 

Specific  demographic  questions  profiling  the  FAM  were  included.  Variables 
taken  into  consideration  4re  age,  sex,  education,  major  fields  of  study,  years 
in  higher  education,  and  academic  status. 

It  was  interesting  to  examine  whether  or  not  the  FAM  is  tenured  and  whether 
or  not  this  person  is  full  time  or  nonacademic,  etc.    Other  questions  include 
those  about  length  of  time  at  institution  and  professional  experience  in  radio 
and  broadcasting.    Uhen  compiled,  this  information  provides  opportunities  for 
additional  interpretation  of  the  findings. 

The  questionnaire  contains  items  asking  for  information  about  the  station 
including  enrollment,  licensee,  call  letters,  age  of  station,  and  power.  It 
also  requests  information  about  population  of  listening  area  and  some  related 
information  about  FM  radio  in  the  station  area.    These  are  descriptive  data 
important  in  the  operation  of  all  mass  media  operations.    A  question  to  identify 
NPR  affiliates  is  included  in  order  to  isolate  and  develop  this  subcategory. 
Additional  information  on  news  service,  programming  sources,  and  station 
membership,  would  allow  the  development  of  comprehensive,  inclusive  lists  of 
memberships  and  programming  sources.    Identification  of  parent  division  of 
source  for  station  accountability  was  also  requested. 

Two  pages  of  the  questionnaire  dealt  with  programming.    The  resulting 
information  was  used  for  program  content  analyses  and  broadcast  operation.  A 
music  offering  list  was  developed  after  consultation  with  musicologists  and 
radio  music  directors.    Questions  also  pertain  to  satellite 
recept  ion-transmission  capabi 1 i  t  ies. 

The  section  on  personnel  examined  such  issues  as  number  and  classification 
of  employees  at  the  stations.    The  sections  also  examined  technical  backup 
personnel  as  a  separate  entity. 

The  funding  section  provided  financial  data  on  station  expenditures  and 
sources  of  the  funding. 

The  last  section  of  the  questionnaire  dealt  with  general  policy  and 
decision-making  patterns  and  a  statement  of  basic  philosophy.  Philosophy 
statements  would  be  compiled  and  reported  where  consent  allowed. 


Data  Analyses 

The  analyses  of  the  data  received  from  this  survey  were  done  at  Indiana 
University  of  Pennsylvania  (lUP)  under  the  guidance  of  Mark  Staszkiewicz, 
director  of  Institutional  Research. 

For  initial  as  well  as  follow-up  data  analyses,  the  Statistical  Package  for 


Page  3  of  7 


the  Social  Science  (SPSS)  (Nie,  1^75)  was  used.    This  picKage  allowed 
subgrouping  into  defined  factor  lists.    Giuen  the  wide  range  of  Mariability  in 
the  data  and  unequal  cell  N^s,  the  SPSS  package  is  very  accomodating  to 
descriptive  studies.    In  order  to  identify  and  focus  upon  certain  trends  and 
patterns^  means,  median,  modes,  and  ranges  were  computed  and  interpreted. 

The  analyses  of  the  subgroups,  as  well  as  that  of  all  stations,  is  included 
where  large  ranges  exist.    In  a  particular  case,  such  as  the  FAM  profile,  this 
was  not  necessary  due  to  the  consistency  and  similarity  of  received  data. 

The  major  questions  ^re,  for  the  most  part,  discussed  and  ther  illustrated 
within  the  confines  of  numerous  tables.    Althougii  certain  summations  and 
tentative  conclusions  are  reached  in  this  study,  the  inclusion  of  summarized  raw 
data  provides  the  reader  an  opportunity  to  agree  or  disagree  with  them. 

This  straighi-f orward  multivariate  analyses  and  explanation,  presented 
section  by  section  with  accompanying  tables  provided  the  greatest  efficiency  in 
analyses  and  improved  the  effectiveness  of  interpretation.    A  limitation  to  the 
survey  method  was  the  differing  levels  of  frequency  refponse.    Uhere  response 
was  limited,  interpretation  would  not  be  final  but  would  be  noted  as  tentative. 

Also,  in  order  to  maintain  the  integrity  in  the  reporting  of  the  findings, 
the  Frequency  of  Response  (FOR)  was  used  for  comparative  purposes  rather  than  ti^ 
This  FOR  or  percentage  of  N  was  noted.    Thir  inclusion  and  exclusion  of  missing 
values  are  treated  on  an  item-by-item  basis. 

As  the  completed  surveys  were  received,  the  data  was  coded  and  entered 
on-line  into  a  Honeywell  file  program  known  as  BEDIT.    BEDIT  is  essentially  a 
prompting  data  entry  program  wh ich,  in  this  case,  was  tailored  specifically  to 
the  needed  variable  list.    An  SPSS  "run"  program  was  written  which  entered  the 
columned  data  formated  by  BED!T.    The  e5fi^:iency  of  managing  data  input  and 
analyses  was  thus  greatly  enhanced.    SPSS  was  also  conducive  to  the  development 
of  descriptive  tables;  these  included  items  where  the  information  wrs 
qualitative  rather  than  quanitative-    Examples  of  these  include  Formet  Types, 
Outside  Programming  Sources,  Person  to  Ulhom  FAM  Responsible,  and  others. 

Throughout  the  process  of  statistical  analyses,  an  experienced  research 
team  from  the  Applied  Research  Laboratory,  lUP,    was  also  available  for  any 
needed  assistance.    The  professional  support  helped  insure  that  data 
interpretation  would  be  relevant  and  accurate. 


Overview  of  Results 

Discussion  of  the  findings  focused  upon  thf  major  elements  of  the 
methodological  framework  in  the  areas  of  station:    (1)  demographics;  (2) 
funding;    (3)  organization  and  structure;    (4)  personnel;    (5)  operation;  (6) 
programming;  and    (7)  philosophy  or  mission.    For  a  more  detailed  accounting  of 
the  findings,  see  Leidtnan  and  Lamberski  (1986). 

All  findings  have  been  derived  from  the  243  completed  questionnaires. 
This  represented  a  36.3  response  rate  (670  were  mailed  out).    NPR  responses 
equaled  51;  they  represent  7.91X  of  the  total  population  and  2VA  of  the  returned 
replies.    Non-NPR  stations  participating  numbered  192,  or  28.65X,  of  the  total 
population,  or  797.  of  the  respondents.    Of  the  192  non-NPR  stations,  42  were  10 
watt  stations.    They  repr<»sent  6.27"/  of  the  population,  17.28%  of  those 
replying,  and  23/.  of  the  non-NPR  stations  participating  in  this  study.  Non-NPR 
stations  with  power  greater  than  10  watts  numbered  150,  representing  22.38>:  of 
the  population  and  61 .72X  of  Ihe  respondents. 

Both  the  10  watt  stations,  as  well  as  those  with  power  greater  than  10 
watts,  are  included  in  the  general  category  of  non-NPR  stations  and  were  given 
their  own  subheadings  as  well.    This  subdivision  allowed  for  examination  of 
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trendf  among  non-NPR  stations  as  well  as  component  parts. 

For  purposes  of  this  paper,  the  major  findings  will  be  highlighted. 

High^qhtf  j  Firi^jhqy 

The  inuestigation  examined  data  obtained  from  questionnaires  sent  to 
selected  KM  noncommercial  stations.    Initial  analyses  of  demographic  data 
indicated  these  stations  could  be  ciustereo  into  three  noncommercial  groups. 
These  groups  can  be  demographical ly  defined  asi 

1.  National  Public  Radio  (NPR)  Affiliates; 

2.  Large  Non-NPR  Affiliates  <over  10  watts)}  and 

3.  Small  Non-NPR  Affiliates  <10  watts  or  under).    This  thiro 

group  has  been  ordered  by  the  FCC  to  be  phased  out. 
All  NPR  stations  are  "Corporation  for  Public  Broadcasting  Qualified" 
meaning  they  meet  certain  financial,  facility  and  personnel  requirements  which 
incl ude : 

1.  Daily  schedules  of  at  least  18  hours  of  programming  per  da/, 

365  days  per  year; 

2.  A  minimum  of  5  full-'  ime  professional  staff; 

3.  An  adequate  (^wo  studio)  physical  plant;  and 

4.  Budget  of  at  least  $100,000  annually. 

These  criteria  place  NPR  stations  at  a  distinctively  different  level  of 
operations  and  planning  than  most  other  college  and  university  FM  stations.  The 
NPR  status  not  only  identifies  a  station  whose  resources  and  commitment  are 
superior  to  most  FM  noncomm*>rc ial  itations,  but  also  administratively  indicates 
continued  support  in  order  to  maintain  NPR  affiliation. 

Given  this  identified  demographic  clustering,  the  f  ol  louiinQ  rank  order 
summary  of  the  major  findings  can  be  presented. 

I.  BUDGET 

a.  A  majority  of  stations  are  expected  to  operate  fully  functional 
broadcast  operations  on  a  small  financial  base. 

b.  Stations,  in  general,  suffer  from  a  consistant  level  of  financial 
support  • 

c.  Sources  of  budgetary  support  vary  by  demographic  group  and 
inconsistency  over  time. 

d.  NPR  Stations  have  a  superior  budgetary  base  as  compared  to  other 
demographic  groups. 

e.  Generally,  stations  suffer  from  inadequate  commitment  from  parent 
inst  i  tut  ions. 

II.  STATION  ORGANIZATION  AND  STAFFING  (exclusive  of  NPR  affiliated  stations) 

a.  Stations  have  inadequate  technical  support. 

b.  Time  allotted  to  professional  station  managers  is  generally 
inadequate  or  split  with  other  Institutional  responsibilities, 
lianager'^s  time  devoted  to  station  operations  appears  consistently 
inadequate. 

c.  Most  stations  indicate  ^  heavy  dependence  upon  volunteer  help  to 
operate  the  station. 

d.  There  Is  a  consistent  expectation  that  the  station  will  maintain  a 
**prof essional  sound"  even  given  the  reality  of  a  mostly 
non-prof esi onal  volunteer  student  staff. 

e.  Most  stations  ha^e  a  lack  of  adequate  compensation  or  reward  system 
for  student  staff. 
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a.  Format  varies  widely  by  den^ographic  group  and  institutional 
expectations.    At  best ,  the  nonccnvnerc iai  spectrum  is  inconsistent 
in  an  identifiable  format. 

b.  Programrning  covers  the  full  gambit  of  sound,  from  classical  to 
Jazz  to  reck  I  etc. 

c.  Dati  reveals  inconsistent  operating  times  during  "normal" 
programming  periods.    Particular  concern  was  identified  gi^/en  the 
inconsistent  operating  time  bctu«een  session  recesses  for  FM  stations 
affilit&ted  with  academic  i  nst  *  ^.ut  i  ons. 

IV.  STATION  PriiLOSOPHIES 

a.  Survey  data  indicates  little  consistent  thought  or 
conceptual ization. 

b.  Station  philosophy  varies  depenoing  upon  station  matAvt  thrust 
and  selected  format. 

In  summary,  the  findings  point  to  vast  yet  specific  differences  for  FM 
noncommer  ical  station^v.    These  differences  are  clearly  identifiable  between  the 
three  demographical ly  defined  groups.    Within  group  variablity  is  hiphly 
dependent  upon  the  parent  institution  and  NPR  affiliation. 


Recommendations 

There  are  positive  and  negative  aspects  of  this  instrument.  Although 
there  is  much  to  be  said  for  some  questions  of  an  open-ended  variety,  it  renders 
more  difficult  the  task  of  coding  and  entering  such  dat?  oto  a  computer 
program.    In  retrospect,  it  probably  would  have  been  more  efficient  to  have 
designed  a  questionnaire  in  whtci)  there  would  be  an  object  list  of  alternative 
responses.    HoiMever,  this  possibly  would  have  distorted  the  results  through  a 
bias  built  in  by  suggested  ans(Mers  printed  on  the  quest  i  onai  re .    As  it  wa^,  the 
respondents  were  free  to  fill   in  the  questionnarie  with  more  exact  answers  as  it 
suited  them.    Other  recommendat ions  woul d  includet 

1.  Shortening  the  questionnaire  by  listing  alternatives  or  eliminating 
less  productive  items.    Or,  having  an  initial  mailing  with  a  second  follow 
through  mailing  thus  spreading  the  requested  information  over  time. 

2.  Develop  a  follow-up  procedure  where,  depending  upon  item  responses, 
a  selected  sample  of  respondents  would  be  contacted  for  in-depth  telephone 
discussion  and  elaboration. 

3.  Given  the  identified  three  separate  respondents,  ievelop  questions 
unique  to  those  respective  three  areas  which  provide  more  in-depth  explanation. 

4.  Develop  an  incentive  system  and/or  check  system  to  make  sure  the 
senior  administrator  fills  out  or  verifies  the  reported  data. 

5.  Provide  a  list  of  terms  either  before  the  start  of  the  questionnaire 
or  define  terms  within  item  stems  or  listed  alternative  responses.    This  is 
particularly  '-^portant  in  collecting  data  on  policies  and  procedures,  and 
personnel . 

6.  Convert  some  of  the  categorical,  open-ended  items  to  scaled  indices. 

Page  6  of  7 


492 


This  would  bf  particularly  possiblt  gigtn  tht  known  pattern  of  responsts  from 
th  is  study. 

7.  V/isually  improvt  tht  instruntnt  through  layout  and  dtsign  to 
increase  respondent  par t ic i apt i on  and  mot i gat  ion. 

8.  Develop  visual  questionnaire  responses.    For  example:    a  time  grid 
would  have  aided  in  the  collection  of  music  type  and  hours  broadcast. 

9.  Given  the  pattern  of  responses  from  the  initial  survey,  develop  a 
branch  ng  strategy  within  the  quest ijnnaire  so  that  not  all  items  ne»d  be 
responded  to  d^tnding  upon  primary  i-esponses. 
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APPENDIX 
Survey  Instrument 


The  purpose  of  this  exercise  is  to  gather  data  on  noncom- 
mercial FM  radio  stations  affiliated  with  colleges  and  uni- 
versities in  the  United  States.     Results  will  be  used  in 
a  descriptive  analysis  of  college  radio  in  the  1980s. 

Faculty-Advisor-Manager  (FAM)  Information       (If  more  than 
one  FAM  is  employed,  please  have  chief  executive  fill  this 
sect  ion  out . ) 

Age  (check  one)  Education  (circle  highect  received) 

Less  than  30  BA ,  BS 

MA-  MS 

MFA,  MBA,  ABD 
PhD,  EdD 
DA,  JD 

 field 

of  most  recent  studies  (last 
degree ) 

Where  was  the  highest  degree 
earned? 


31-35 
36-40 
41  -45 
46-50 
51-55 
56-60 
61-05 


Sex  

Professional  years  of  involvement  in  higher  education: 
0123456789      10  or  more 

Tenured?      Yes  No 

If  no:       Fuxl-time      Regula-^  lure-track 

o^ 

Part-t  ime      Non- academic 
(Please  circle  one  of  the  above) 

How  long  have  you  been  with  your  institution? 

How  long  have  you  been  in  the  FAM  position?^  


Previous  to  your  present  post,  how  many  years  have  you 
professionally  worked  in  radio?      Full-time  Part-time 

Previously,  what  was  the  hig:hest  professional  broadcasting 
job  you  ever  held?  
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Demographic  Information 

University  or  college?   Overall  enrollment? 


Who  is  the  station  licensee? 


Call  letters 


Year  of  first  license 


Dial  position 


Licensed  power 


Effective  radiated  pov^er 


Number  of  potential  listeners  in  your  area  (community  and 
university  combined) 


Description  of  community  (rural,  urban,  suburban) 


Number  of  FM  stations  in  your  market 


Number  of  other  college-  or  university-affiliated  stations 
(not  attached  to  your  institution)  in  your  market  


Are  you  a  National  Public  Radio  affiliate? 


News  affiliation  (AP,  UPI,  Mutual,  etc.) 


Programming  affiliation  (Texaco,  Metropolitan,  Longhorn, 
RKO,  WFMT)--List  all  applicable 


Station  memberships  (NAB,  NFCB,   IBS,  etc.) 


To  what  academic  unit  (department  or  school)  if  any, 

is  your  station  attached?  

If  none,  please  explain:  
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ERIC 


Programming  (Pltase  include  as  much  detail  as  possible) 

Daily  operating  hours  (example  8  a.m. -2  a.m.)  

Academic  Year 

Weekdays  (Monday-Friday) ^  


Weekends  (Saturday-Sunday ) 


Holidays  when  school  is  in  c^ession 


Holidays  (such  as  Labor  Day)  when  school 
is  not  in  session) 


Check  here  if  the  above  is  true  all  year 
—  round  and  please  go  on  to  next  section. 

Winter  and  Spring  Break 

Weekdays  ^  

Weekends 


Holidays  (example:  Christmas  Day) 
Summers 

Weekdays  

Weekends 


Holidays  (example:     July  4th) 


Does  your  station  close  for  che  summer? 
If  so,  when  (approximately)   


When  do  you  resume  operation? 


Does  your  station  have  satellite  reception 

equipment?  Yes  No 

Does  your  station  have  satellite 

transmission  equipment?  Yes  No 

What  is  the  tife  of  the  person(s)  who 
approve  specific  programs  or  major 

programming  changes?   


Does  the  sLation  have  a  distinctive 
format  or  ''sound"?  (Please 

specify  if  ''yes.")  Yes  No 
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Types  of  Programming  During  Normal   (Academic  School  Year) 
Hours  of  Operation 

Total  hours  When 

per  week  (M-F,   5-7  p.m.) 

Music 

Classical   

Jazz  " 

Blues   

Country  &  Western  ^^^^^^^^  ~ 

Bluegrass   

Folk    ~ 

Broadway 

MOR  ^^^^^^^^ 

Adult  Contemporary   

Christian  Religious  HZI^^^^Z 

Disco   

Regf^ae 

Progressive  Rock  Z^^Z^ZZZZ 

AOR    ~ 

Heavy  Metal   

New  Wave   

Punk 

Retro  ,pective  rock     

Top  40   ^^^^^ 

News 

Sports  ^^^^^^^^ 

Public  Affairs  ^^^^^^^^ 

Drama   

Talk  ~  ^H^I^HZ^ 

Cl;^ssroom  (instructional)   

Religious  (ex.  Sunday) 

morning  church  hour)     

Other  (please  specify) 


How  much  of  your  programming  is  generated  by  outside  sources? 
(Ex.     Newsweek  FM  or  Captured  Live)?   hours  per  wk. 


Please  name  sources  and  shows: 
Sources  Shows 


ERJC 
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Personnel 

1.     How  many  full-time,  paid  technicians 
does  your  station  have?  


2.     If  none,  who  maintains  equipment? 


5.     Who  possesses  an  FCC  1st  Class  or 
General  License  and  signs  technical 
logs?  

4.  How  many  people  (both  non-student, 
professional  and  students)  make  up 
your  total  staff  fcr  the  station? 


5.     How  many  students  work  at  your  station 

per  semester?      Full-time  :  Part-t  ime  : 


6.  How  many  (nonprofessional)  students 
receive  monetary  compensation?  

7.  What  positions?  


8.     How  many  students  receive  academic  credit 
for  working  at  the  station?   


9,     What  position  do  they  hold? 


10.     Is  it  possible  for  a  student  to  receive 
both  credit  and  money  for  working  at 
the  station? 


11.     If  yes,  under  what  circumstances? 


12.     Approximately  how  many  students  work 
in  a  purely  unpaid  voluntary  capactiy 
at  the  St? tion? 


13.     What  positions  are  these? 
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APPENDIX 
Survey  '.nstrument 


Funding 

What  is  the  station's  operating  budp^et?  

From  where  do  the  operating  monies  come? 

(Please  express  m  percentages)  Percentage 

Specific  general  college  or  university  funds   

General  college  funds  as  administered  by 

academic  department  or  school   

Student  funds  (activity  fees,  etc.)   

Endowment 

Grants  (monies  received  through  specific 

grant  applications)   

Donations  (telethons,  raffles,  etc.)   

Other  sources: 


Policies  and  Procedures 

1.  What  is  the  title  of  the  person  who  manages  the  radio 
station?  

2.  Is  this  person  a  paid  professional?    Yes  No 

3 .  What  percentage  of  the     otal  contractual  commitment  of 
of  the  manager's  time  is  devoted  to  the  radio  station 
(i.e.,  release  time,  load  reduction)?  

1"^"  students  are  integrally  involved,  what  is  the  student 
chain  of  command?  

4.  To  whom  is  the  student  leader  directly  responsible? 

5.  To  whom  is  the  FAM  directly  accountable?  

6.  Do  written  policies  and  procedures  on  station  operation 
exist?    Yes  No 

7.  Please  make  a  statement  reflecting  the  basic  philosophy 
of  the  radio  station  with  which  you  are  associated. 
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Effects  of  Selected  Filmic  Coding  Elements 
of  TV  on  the  Development  of  the 
Euclidean  Concepts  of  Horizontal ity  and  Vertical ity 
in  Adolescents 


Beth  Eloise  Lynch 
U.S.D.  305,  Salina,  Kansas 
University  of  Kansas 
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Investigation  of  the  function  and  effects  of  selected  filmic  coding 
elements  of  television  In  learning  and  employment  of  those  filmic  coding 
elements  In  exploring  the  presence  and  development  In  adolescent  high 
school  students  of  spatial  skill  Involving  concepts  of  horizontal ity  and 
'ertlcallty  were  the  two  major  objectives  of  this  study.   The  structure 
of  the  study  combined  approaches  established  by  G.  Salomon  in  the  area  of 
filmic  coding  elements  and  L.  Liben  In  her  work  with  Plagetlan  spatial 
concepts. 

The  Inquiry  was  concerned  with  the  differential  role  of  media's 
symbol  systems  In  the  acquisition  of  knowledge  and  In  the  way  these  sym-> 
bol  systems  can  function  as  cultivators  of  mental  skills.   The  particular 
area  of  knowledge  pertained  to  the  Euclidean  space  concepts  of  horizontal - 
ity  and  vertical Ity  which  Involve  the  mental  ability  of  spatial  orientation. 

Rationale 

based  on  the  general  premise  that    e  symbol  system  is  the  most  ess- 
ential attribute  relating  the  two  "syster  '  of  media  and  cognitions,  Salo- 
mon argues, 

"symbol  systems  addres?  themselves  to  different  aspects  of 
the  world,  and  that  some  systems  rendf'r  specific  aspects 
better  than  others  ...  Symbol  systems  vary  as  to  the  cog- 
nitive systems  they  address,  and  given  a  particular  content, 
person,  ard  task,  the  Information  they  carry  requires 
different  amounts  of  mental  recoding  and  elaboration.  Thus 
the  better  the  correspondence  between  the  way  information  is 
presented,  the  less  recoding  Is  needed  and  the  easier  Is  the 
communication"  (Salomon,  1979, p.  86). 

To  learn  how  media's  symbol  systems  can  be  made  t3  affect  cognition 
under  specific  favorable  conditions  coding  elements  of  media's  symbol  sys- 
tems were  used  to  activate,  short-circuit  or  supplant  processes  for  vari- 
ous types  of  learners.   Activation  stimulates  or  calls  Into  action  skills 
with  which  a  learner  has  an  Initial  acquaintance.    In  short-circuiting  the 
coding  elements  provide  ready-made  results  for  the  skill,  while  in  supp- 
lantation  the  entire  skill  process  Is  modeled.   Coding  elements  that  acti» 
vate  skills  facilitate  skill  mastery  in  already  skillful  learners;  coding 
elements  that  overtly  model  (supplant)  skills  facilitate  skill-mastery  in 
Initially  unskilled  learners. 

In  dealing  with  learning  tasks  and  cultivating  mental  skill  mastery 
In  the  area  of  spatial  relations  film  and  television  contain  in  their  sym- 
bol systems  specific  codes  to  represent  relatively  unique  transformations 
In  space  and  time  (e.g.,  slow  motion,  the  zoom  of  a  camera,  rotations, 
split  screen,  and  generated  line  cues).   These  coding  elements  were  used  to 
present  the  Euclidean  space  concepts  of  horizontal Ity  and  vertical ity  to 
high  school  adolescents. 

Although  Plaget  and  Inhelder  (1956)  maintained  that  a  Euclidean 
spatial  system  is  typically  established  by  late  childhood,  other  research 
found  that  children  from  nursery  school  through  the  eleventh  grade  (only 
girls  were  Included  from  ninth  to  eleventh  grade)  and  many  college  students 
were  unsuccessful  on  horizontal  water-level  tasks  (Thomas,  Jamison  and  Hum- 
mel, 1973;  Wlllemsen  and  Reynolds,  1973;  Thomas  and  Jamison,  1975;  and 
Harris,  Hanley  and  Best,  1975).  Vertical Ity  tasks  (drawing  trees  and  houses 
on  hills  with  various  degrees  of  incline)  were  Introduced  in  Liben 's  study 
(1978).  Working  with  seniors  in  high  school,  Liben  found  a  sex-related 
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difference  to  be  present  with  both  tasks  of  vertical Ity  and  horizontal Ity. 
Evidence  indicated  that  Imperfect  performances  by  males  and  females  showed 
no  significant  difference  in  number  or  type  of  task  errors,  nor  in  scores 
on  field  dependence/independence  (EFT)  and  spatial  orientation  (Guilford- 
Zimmerman)  measures.   Performance  on  the  Piagetian  spatial  tasks  were 
significantly  correlated  with  performance  on  the  EFT  in  both  sexes.  In 
general  males  performed  significantly  better  than  females. 

This  study  attempted  to  ascertain  whether  the  filmic  coding  ele- 
ments of  split  screen,  slow  motion,        ated  line  cues,  the  zoom  of  a 
camera  and  rotation  could  aid  in  the  development  of  the  Euclidean  spatial 
concepts  of  ho'^izontality  and  vertical  ity  and  the  skill  mastery  of  spatial 
orientation  in  adolescents. 

Questions  specifically  addressed  were 

1.  Would  the  type  of  filmic  coding  elements  used  in  presenting 
Euclidean  spatial  concepts  significantly  affect  the  mean  sccre 
of  high  school  adolescents  on  a  test  based  on  those  concepts; 

2.  For  learners  who  have  similar  levels  of  understanding  would  the 
type  of  filmic  coding  element  used  in  presenting  Eucli^^an  spatial 
concepts  significantly  affect  the  mean  score  on  a  test  of  those 
concepts  given  prior  to  and  following  the  presentation; 

3.  Would  there  be  a  significant  difference  in  the  mean  score  of  high 
school  adolescent  males  and  females  on  i  test  of  Euclidean  spatial 
concepts  following  the  viewing  of  a  television  tape  using  selected 
filmic  coding  elements; 

4.  Following  the  viewing  of  a  television  tape  using  selected  filmic 
coding  elements  would  there  be  a  significant  differerxe  in  the 
mean  score  of  high  school  adolescent  ninth-graders  and  high  sch- 
ool adolescent  twelth-graders  on  a  test  of  Euclidean  spatial 
concepts; 

5.  Would  the  viewing  of  television  tapes  using  selected  filmic  coding 
elements  to  provide  training  on  Euclidean  spatial  concepts  sig- 
nificantly affect  the  mean  score  of  high  school  adolescents  on  the 
Gilford-Zimmerman  Aptitude  Survey,  Part  V  Spatial  Orientation? 

Procedure 

Twb-hundred-forty  randomly  selected  subjects  for  the  study  were 
placed  in  four  groups  composed  of  fifteen  male  and  fifteen  female  fresh- 
man and  senior  adolescents.   They  were  all  from  one  four-year  north-central 
Kansas  public  high  school  of  about  1025  students. 

They  were  all  pre-tested  for  mastery  level  of  the  concepts  of  hor- 
izontal ity  and  vertical ity.   The  horizontal  test  involved  drawing  in  the 
water  level  of  half  filled  cup  outlines  positioned  at  various  degrees  of 
tilt.   The  vertical  concept  required  the  subject  te  draw  'rees  on  hills 
wHh  various  degrees  of  slope  and  to  draw  bulbs  hanging  trom  wires  in 
trailers  parked  on  hills  with  various  degrees  of  incline.   The  Group 
Embedded  Figures  Test  (GEFT)  and  the  Guil ford-Zimmerman  Aptitud.  Suivey- 
Part  V  Spatial  Orientation  were  administered  to  all  subjects  before  treat- 
ment. 
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A  repeated  measures,  4x2x2x2  factoral  design,  employing  two  MANOVAs 
was  used.   The  factors  were  the  two  sexes,  the  two  high  school  grade  levels 
of  freshman  and  senior,  high  and  low  groups  of  EFT  scores,  four  experimental 
groups  and  pre/post  tests.   There  were  three  treatment  groups  and  a  control 
group.   The  treatment  conditions  were  those  of  activation,  short-circuiting 
and  supplantation  used  by  Salomon  (1974b).   The  repeated  measures  were  the 
tests  of  horizontal ity,  vertical ity  and  Part  V  Spatial  Orientation  of  the 
Gun  ford-Zimmerman  Aptitude  Survey.   The  horizontal  and  vertical  measures 
were  used  to  reflect  knowledge  of  those  concepts  and  determine  if  any  gain 
in  those  concepts  occurred  following  treatment.   The  Spatial  Orientation 
section  of  the  GZAS  was  used  to  indicate  if  any  mental  skill  development 
in  the  area  of  spatial  relations  occurred  following  treatment. 

Tests  and  treatment  were  conducted  on  two  consecutive  days.   On  the 
first  day  all  subjects  were  tested  for  knowledge  of  the  concepts  of  hori- 
zontal ity  and  vertical ity.   The  GEFT  and  Part  V  of  the  GZAS  were  also  ad- 
ministered.  On  the  second  day  each  group  viewed  one  of  four  television 
presentations.   Three  television  tapes  were  used  to  present  examples  of 
the  invarient  horizontality  of  liquid  and  the  verticality  of  objects  (peo- 
ple, trees  and  houses).   One  of  each  of  the  three  processes  of  activation, 
short-circuiting  and  supplantation  was  employed  in  one  of  the  tapes.  The 
control  group  viewed  a  television  tape  of  nature  scenes  set  to  music. 
Task  booklets  were  used  during  the  treatment  portion.   They  were  made  up 
of  outlines  which  corresponded  to  objects  which  appeared  in  the  treatment 
tapes.   At  various  plac*>s  throughout  the  tapes  the  subjects  were  asked  to 
perfom  a  task  which  pertained  to  the  concepts  being  demonstrated. 

Using  the  SPSS'*  language  and  operations,  two  MANOVAs  were  computed 
for  the  dependent  variables  of  horizontality,- verticality  and  spatial 
orientation.  Means  and  standard  deviations  were  computed  for  both  pre  and 
post  test  measures  of  horizontality,  verticality  andPart  V  of  the  GZAS 
for  subjects  in  the  supplantation,  short-circuiting,  activation  and  con- 
trol groups.   Phillais,  Hotellings  and  Wilks  multivaritate  tests  of  sig- 
nificance were  employed  to  determine  if  significant  differences  existed 
among  the  mean  scores  of  the  various  groups.   Univariate  F- tests  were  car- 
ried out.   All  factors  from  four-way  interactions  to  each  individual  factor 
of  sex,  grade  level,  treatment  condition,  and  time- of  the  first  MANOVA  and 
sex,  EF  scores,  treatment  condition,  and  pre  and  post  test  scores  of  the  - 
second  MANOVA  were  examined.   Graphs  were  drawn  for  all  findings  which  re- 
vealed significant  differences  at  the  .05  or  lower  level  of  probability. 

Results 

^"Findings  for  the  study  came  from  the  examination  of  two  MANOVAs. 
The  first  one  was  b-3ised  on  data  for  the  variables  of  sex,  grade  lavel, 
treatment  group,  and  time.   The  second  MANOVA  included  the  independent  var- 
iables of  sex,  EF  scores,  treatment  groups  and  time.   These  two  MANOVAs 
were  computed  for  each  of  the  dependent  variables  of  horizontality,  verti- 
cality and  spatial  orientation. 

In  determining  whether  the  type  of  filmic  coding  elements  used  in 
presenting  Euclidean  spatial  concepts  would  affect  the  performance  of  hi§h 
school  adolescents  on  tests  based  on  those  concepts. the  results  of  the 
MANOVA  based  on  the  Interaction  between  Treatment  Group  x  Time  on  the  hor- 
izontal measures  produced  non-signif-,cant  multivariate  f-tests  (p<.198). 
However  the  univariate  F-test  for  the  ore  and  post  test  measures  on  the 
curved  cup  outline  was  of  borderline  significance  (£<.057).   A  look  at 
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the  graph  of  the  pre  and  post  test  results  of  the  four  experimental  groups 
revealed  that  the  r>upplantat<on  and  short-circuit  groups  appear  to  relfect 
the  largest  amounc  of  change. 

As  for  the  vertical  measures  the  multivariate  _F  for  Treatment  X 
Time  was  significant  (£<.043).   The  univariate  F-tests  revealec!  a  level  of 
bignificance  for  the  test  with  trees  on  hillsides  was  .253  but  for  the 
hanging  bulb  test  the  level  of  significance  was  .031.   On  viewing  the  graphs 
of  the  pre  and  posttest  scores  for  the  hanging  bulb  test  it  can  be  seen 
that  t:*  activation  group  achieved  a  change  greater  than  twice  that  of  the 
control  group  and  that  the  short-circuit  group  increased  their  scores  over 
four  times  that  of  the  control  group. 

In  addressing  the  question  of  the  affect  of  filmic  coding  elements  used 
in  the  presentation  of  Euclidean  spatial  concepts  to  learners  of  similar 
levels  of  understanding  the  multivariate  F  for  the  interaction  of  Treat- 
ment Group  X  EF  scores  X  Time  was  non-sigrTificant  (£<.687)  on  the  horizont- 
al measures.    Once  again  on  the  vertical  measure  the  MANOVA  using  Sex  X 
Group  X  EF  scores  X  Time  provided  a  four-way  interaction  having  a  multi- 
variate F  at  the  .017  level  (Pillais,  Hotellings  and  Wilks). 

TFTe  univariate  F-test  was  non-significant  (p<.100),for  the  difference 
on  the  drawing  of  trees  on  inclines  but  the  univariate  F  for  the  difference 
on  the  drawing  of  bulbs  hanging  in  trailers  parked  on  inclines  was  signifi- 
cant (£<.026).   A  look  at  the  graphs  of  these  findings  for  the  bulb  in  trai- 
Ueitest  reveal  a  consistent  pa':tern  of  higher  results  for  EF2  (high  scores) 
group  over  those  of  the  EFl  gro'ip.   The  level  of  performance  by  both  EFl 
and  EF2  is  not  as  high  for  femaies  as  for  males. 

Treatment  Group  X  Time  interaction  for  the  multivariate  test  pro- 
duced an  £  which  was  significant  (p<.039).   The  univariat-s  F-test  for  the 
bulb  in  tBailer  measure  was  significant  at  the  .025  level.    The  varTous 
treatment  groups-.  «lo  not  follow  the  same.-pattBrn  for  either  the  male  or  fe- 
male or  the  two  levels  of  EF.   The  short-circuit  group  shows  the  greatest 
gain  from  pre  to  posttest  scores  for  both  male  groups.    For  the  females, 
activation  appears  to  be  the  most  effective  for  the  EF  1  group,  but  supp- 
lantation  and  short-circuit  seem  to  be  the  most  productive  for  the  EF  2 
group.   This  would  not  follow  the  work  or  findings  of  Salomon. 

In  checking  on  the  role  of  sex  in  the  performance  of  adolescent  males 
and  females  on  measures  of  vertical ity  the  test  scores  show  a  significant 
multivariate  F-test  (£<.001).   This  substantiated  the  superior  adolescent 
male  performance  over  adolescent  females  found  in  past  studies  (Liben,  1978). 

As  for  the  role  of  grade  level  on  the  effect  of  filmic  coding  elements 
in  working  with  concepts  of  vertical ity  the  multivariate  test  (Pillais) 
which  deal  with  the  average  mean  score  for  the  two  levels  produced  a  non- 
significant f  (£<.157).   The  univariate  F-test  for  the  average  mean  score  on 
the  test  of  Vertical ity  for  the  bulb  in  trailer  test  was  .075.   The  results 
of  the  MANOVA  for  the  interaction  of  Time  X  Level  revealed  a  significant 
univariate  F^  (p<.040)  for  the  mean  scores  on  the  bulb  in  trailer  test.  The 
graph  of  Level  X  Time  pictures  the  greater  increase  made  by  seniors  over  that 
of  the  freshman  on  the  vertical  measure  of  the  bulb  in  trailer. 

The  evidence  of  these  two  significant  differences  in  sex  and  grade 
level  for  both  the  horizontal  and  vertical  measures  is  most  important  to 
recall  when  interpertation  of  the  other  factors  of  the  study  are  being  re= 
viewed. 
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A  four-way  interaction  revealed  by  the  first  MANOVA  on  the  horizont- 
al Measures  produced  a  multivariate  test  of  significance  (Pillais)  with  a 
significant  F  (p<.022)  for  Sex  X  Group  X  Level  X  Time.   The  univariate 
was  non-signTfiTcant  for  both  the  straight-sided  cup  outline  (£C.067)  arTd 
for  the  curve-sided  cup  outline  (£<.100). 

Examination  of  the  graphs  of  the  four-way  interaction  show  the 
senior  males  had  higher  retest  mean  scores  in  all  groups,  scoring  above 
freshman  males  anH  both  freshman  and  senior  females.   Senior  females 
scored  consistently  above  the  freshman  female  mean  scores  on  the  retest 
measures  and  surpassed  the  freshman  male  performance  In  the  short-circuit 
and  activation  groups. 

Senior  girls  narrowed  the  difference  in  the  mean  scores  for  males 
and  females  at  the  senior  level  in  both  the  supplantation  and  activation 
groups.   Freshman  girls  made  ga1is  on  the  repeated  measures  mean  scores 
over  freshman  boys  in  the  short-circuit  and  activation  groups,  but  the 
freshmen  boys  showed  larger  gains  over  the  freshman  girls  in  the  supplant^ 
ation  group.   The  freshman  girls  performed  well  below  the  senior  boys  in 
all  groups. 

As  for  the  effect  of  the  various  treatments,  the  short-circuit  and 
activation  appeared  most  effective  for  senior  boys.   The  freshman  boys 
showed  their  greatest  gain  in  the  supplantation  group.   All  three  treat- 
ments proved  beneficial  far  senior  girls  with  activation  and  supplantation 
supplying  the  greatest  rate  of  gain.   Freshman  females  appeared  to  bene- 
fit most  from  the  short-circuit  tape. 

The  existence  of  this  four-way  interaction  points  out  the  difficul- 
tly of  trying  to  understand  the  influence  of  the  filmic  coding  elements  in 
the  light  of  the  complaxity  of  the  sex  and,  level  related  differences  which 
have  been  noted. 

Whether  the- use  of- f11mic:cod1ng:elemBntS"tn"providinQ  trainlng.-on 
horizontal. and  vertical  tasks  could  have  any  effect  on  the  skill  mastery  of 
spatial  orientation  was  the  final  concern.   Part  V,  Spatial  Orientation,  of 
the  Guil ford-Zimmerman  Aptitude  Survey  was  used  to  measure  the  mental  ability 
of  spatial  orientation.   Using  sequential  sums  of  squares,  the  first  MANOVA 
revealed  a  four-way  interaction  of  Sex  X  Group  X  Level  X  Time  which  pro- 
duced a  significant  F  at  the  .015  level. 

These  interacrions  were  graphed  holding  various  groups  constant.  In 
looking  at  the  graphs  of  the  senior  and  freshman  levels  of  the  males  in  the 
various  treatment  groups  there  is  a  similar  pattern  for  the  pre/posttest 
performance  of  senior  males  for  the  control,  supplantation  and  activation 
groups.   The  short-circuit  tape  appears  to  have  suppressed  the  change  which 
occurred  in  the  other  three  groups.   The  sequential  sum  of  squares  for  the 
freshman  males,  revealed  the  short-circuit  trea*"ment  provided  the  greatest 
increase  from  the  pre  to  posttest  GZAS  test  scures.   The   re/post  gain  for 
the  activation  group  was  also  at  a  steeper  rate  than  that  of  the  control 
group.   The  males  performed  at  higher  levels  and  showed  greater  gains  in 
the  activation  group  than  in  the  other  experimental  groups. 

For  the  females,  the  graphs  of  the  various  experimental  groups' 
sequential  sum  of  squares  showed  the  short-circuit  and  supplantaion  groups 
increased  at  the  most  rapid  rate  for  the  senior  subjects.   The  activation 
group  for  senior  females  showed  little  change  from  pre  to  post  means. 
Freshman  females  registered  their  greatest  pre/post  GZSA   score  gain  in 
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the  supplantation  and  activation  groups.   The  short-circuit  group  provided 
little  if  any  change  in  pre/post  RZAS  test  scores  for  freshman  .female. 

The    for  the  siean  square  of  the  interaction  of  Level  X  Time  was 
significant  at  the  .055  level.   The  senior*  mean  square  was  at  a  higher 
level  than  the  freshman  on  bot;  the  pre  and  posttest  administration  of  the 
GZAS. 

Looking  at  the  GZAS  averages  determined  by  use  of  sequential  sums 
of  squares  it  shows  that  sex  has  a  significant  F  at  the  .004  level.  A 
look  at  the  graph  shows  the  males  scoring  signiTicantly  higher  then  females. 
The  graph  showing  the  senior  and  freshman  performances  on  the  GZAS  reveals 
significantly  better  scores  by  the  seniors  than  the  freshmen.  Rather  clear 
patterns  of  performance  for  sex  and  grade  levels  were  established. 

Implications 

From  the  significant  findings  for  individual  factors  and  the  various 
interactions  it  does  appear  that  filmic  codinq^elements  do  affect  the  devel- 
ment  of  the  Euclidean^ftoTrcfifXt  of  horizontal ity  and  vertical ity  and  did 
increase  the  mean  scores  on  the  Gilford-Ziinmennan  Aptitude  Survey,  Part  V 
Spatial  Orientation. of  high  school  freshman  and  senior  adolescents. 

Further  investigation  into  the  effects  of  selected  filmic  coding 
elements  needs  to  be  pursued  keeping  sex,  grade  level,  concept  understand- 
ing, treatment  groups  and  time  all  as  factors. 

The  shape  of  the  container  of  the  horizontal  tasks  does  appear  to 
have  some  effect  on  the  mental  processes  of  the  subject,  but  results  of 
the  horizontal  tasks  did  tend  to  form  similar  patterns  and  produce  common 
significant  findings. 

For  the  vertical  measures  there  were  consistently  different  results 
indicating  different  aspects  were  being  involved.    The  question  of  filmic 
coding  elements  widh  might  aid  in  development  of  understanding  of  each  of 
those  aspects  of  the  concept  of  vertical ity  would  be  open  for  investigation. 

The  presence  and  degree  of  development  of  the  concepts  of  horizont- 
ality  and  vertical ity  of  freshman  and  senior  adolescent  subjects  remains 
an  area  meeding  further  exploration.   The  work  of  Feldman  (1980)  might 
provide  useful  guidelines  in  studying  the  presence  and  development  of  the 
concepts. 

Reduction  of  the  difference  in  the  mean  score  for  various  treatment 
groups  between  males  and  females  needs  to  be  followed  up  to  fill  in  a  vital 
part  of  the  total  picture. 

The  flat  pre/post  mean  scores  produced  by  the  low  EF  groups  indi- 
cate the  need  to  look  into  this  aspect  of  the  study.   Male  and  female 
adolescents  who  have  scored  in  the  lower  EF  group  should  be  studied  to  see 
if  any  particular  selected  coding  elements  are  more  beneficial  than  others 
in  helping  th6m  to  master  the  horizontal  and  vertical  concepts. 

The  significant  findings  based  on  the  use  of  the  Gull  ford-Zimmerman 
Aptitude  Survey  to  reveai  development  of  the  mental  skills  of  spatial  orient- 
ation in  adolescents  through  the  use  of  selected  filmic  coding  elements 
would  be  of  import  to  those  involved  in  education  and  those  who  have  an 
interest  in  occupations  which  employ  spatial  orientation  skills. 
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Ne«phis  State  Regression  Node] 

The  advent  of  low  cost  Bicrocoapater  technology  has  aided  the 
integration  of  coapnter  assisted  instroction  (CAI)  into  the 
classrooB.    Typically,  Bicrocoaputer  software  is  planned  as  an 
attractive  and  adaptable  alternative  to  learning  froa  a  textbook 
or  programed  instroction  book.    Software  created  by  instroctional 
designers  and  sophisticated  prograners  has  taken  advantage  of  the 
■icrocoBpnter 's  graphics  and  sound  capabilities,  learner  inputs, 
feedback,  and  record  keeping  abilities  to  produce  attractive  and 
versatile  products. 

Initially,  the  attributes  of  CAI  suggested  a  Bediaa  capable 
of  presenting  instruction  in  a  new  Banner.    Recent  research, 
however,  has  soggested  that  CAI  aay  be  no  aore  effective  than 
traditional  textbooks  once  the  novelty  of  the  aediiiB  has 
disappeared  (Knin*  Bangert,  C  Villiaas,  1983).    Clark  (1963) 
suggests  a  research  strategy  (and  possible  an  instroctional  design 
strategy)  that  eaphasises  the  instructional  aethods  as  opposed  to 
the  individoal  aediiiB. 

Accordingly,  our  aain  assnaption  in  this  paper  is  that  one  of 
the  coBpnter's  most  powerful  capabilities  lies  in  adapting 
ir.:trnction  to  the  learner.    Adaptive  aethods  typically  found  in 
the  conercially  available  software  ase  a  weak  fora  of  adaptation 
that  relegates  instroctional  decisions  ssch  as  speed,  sequence, 
and  difficulty  to  the  learner.    The  learner  control  or  internal 
control  aethod  is  adaptive  only  to  the  extent  the  learners  can 
■ake  the  necessar*  instructional  Banageaent  decisions  (Johansen  & 
Tennyson,  1963).    ^n  contrast  to  the  learner  control  method  is  the 
program  control  aethod,  often  iapleaented  in  coapnter  aanaged 
instruction  (CHI),  in  which  the  designer  controls  the  learning 
environaent.    Applications  of  CHI  can  range  from  simple  branching 
based  on  the  learner's  response  to  decisions  of  the  nuaber  or 
types  of  examples  the  learner  needs,  or  when  to  exit  the 
in^*    ction.    A  principal  criticism  of  the  prograa-controlled 
od  is  the  designer's  ability  to  establish  prograa  control 
logi    on  criteria  other  than  arbitrary  and  unvalidated  rules 
(e.g.,  60%  correct;  "3  aisses  in  a  row"). 

The  purpose  of  this  paper  is  to  review  three  systematic 
adaptive  instructional  aodels  used  fdr  conpater-based  curricular 
■anageaent.    The  types  of  adaptations  included  are  (a)  quantity  of 
instructional  support  and  incentives,  (b)  aeaningf ulness  of 
problea-solving  contexts,  and  (c)  the  density  of  narrative  text. 
The  first  two  aodels  have  been  extensively  examined  in  our  prior 
research  and  evaluation  studies.    The  third  (contoxt  density) 
■odel  is  still  in  the  developmental  stage,  and   we  will  only 
report  our  preliminary  findings  in  this  paper. 
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M^aftliia  Stata  BanraggiQii  Modal 

Indif itfatliied  learning  strategies  (e.g.*  Keller,  1978;  Bloom 
197i)  profitfe  large  amoonts  of  instractional  sopport,  but 
typically  rely  on  the  &QbJectife  Jitfgaents  of  the  learner  to 
determine  the  amonnt  of  support  required  to  achlefe  an  objective. 
Freqaentlyi  these  strategies  result  in  high  achievers  selecting 
too  much  sapport  and  low  achievers  selecting  too  little  snpport. 
Interest  in  this  problem  led  to  the  .^velopment  of  the  Hemphis 
State  Regression  Model  for  systematically  selecting  the  amoont  of 
instructional  snpport  an  individual  wonld  need  to  achieve  the 
objectives  (Hansen,  Ross,  4  Rakow,  1977)     The  initial  application 
of  this  model  was  directed  at  a  self-instrnctional  unit  covering 
algebraic  rnles  taught  in  an  introductory  college  statistics 
coarse.    A  flow  diagram  sommariiing  the  steps  of  the  model  is 
shown  in  Figure  1. 


Insert  Figure  1  aboot  here 


i«ttiamiin»aMQn     Tfce  following  is  an  explanation  of  each 
component  step  of  the  iiodel.    Step  one  was  the  selection  of 
pretask  (entry  behaviors)  variables  to  use  as  predictors  of 
learner  performance  on  the  task.    This  predictive  process  ii  the 
foundation  of  the  adaptive  model  with  the  basic  rule  of  "if 
predicted  performance  is  low,  increase  instrnctional  support;  if 
high,  decrease  instructional  instructional  support. The  second 
step  was  the  development  of  a  predictive  equation  for  each  lesson 
(one  per  rule)  from  the  results  of  a  sample  group.    In  the  third 
step,  the  predicted  scores  were  matched  to  instructional 
prescriptions  specifying  the  number  of  examples  the  learner  wojld 
require  for  each  lesson.    The  prescriptions  were  in<;orporated  into 
»  computer  program  to  generate  a  prescription  for  each  learner. 
Prior  to  the  treatment,  the  instructional  booklets  ver«i  arranged 
for  each  learner  according  to  the  computer  generated  prescription 
for  each  lesson.    The  lessons  were  then  presented  to  the  learner, 
and  at  the  end  of  each  lesson,  a  formative  post  test  was 
administered.    Lesson  posttest  scores  were  used  to  make  necessary 
refinements  in  the  next  lesson  (i.e.,  adding  or  subtracting 
examples) . 

Evaluation  of  the  model  vas  performed  is  several  studies. 
The  first  study  (Hansen  et  al)  consisted  of  five  treatment  groups. 
One  adaptive  treacs^nt  received  individual  prescriptions  generated 
by  the  model.    A  second  treatment,  group-adaptive,  received  a 
prescription  based  on  membership  in  a  particular  ability  group. 
Two  other  treatments  received  either  low  (2  examples  per  rule^  or 
high  (10  examples  per  rule)  levels  of  instructional  support.  The 
fifth  gronp  received  instructional  support  that  was  varied 
nonadaptively .    The  results  indicated  the  adaptive  group  performed 
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signif icsntlf  better  then  eech  of  the  other  treetaeBts.  Of 
particQlar  signiiicance  was  the  difference  between  the  adaptive 
groQp  and  the  high  Instructional  support  groap.    It  was 
bfpotheslsed  the  dlstdvantage  of  the  high  support  group  was  doe  to 
IneffUlent  Qse  of  Instrictlonal  time.    A  second  stud?  (Ross  4 
R<&koWi  19B0)  coaparlng  Indlvldoallied-tdaptlve  prescriptions  to 
groQP-adaptlve  prescriptions  and  non*adaptive  Instrnctlon  also 
foand  the  Indlvldnaliied-adaptlve  strateg?  to  be  slgnlf Icantlf 
better  thsn  the  grogp-adaptlve  and  non*adaptlve  strategies. 

incftiitiw#  Aita»»aHinig.    An  eitenslon  of  the  Hesphls  State 
Regression  Model  Is  the  varying  of  Incentives  (Ross  4  Rakow, 
1981).    Incentives  (noratllT  10  points  per  lesson)  were  divided  so 
the  lesson  predicted  to  be  most  difficult  was  worth  sore  points 
(e.g. I  20  points)  thsn  the  lesson  predicted  to  be  the  least 
difficult  (e.g. I  0  points).    The  adaptive  Incentives  strategy 
served  to  orient  the  students  to  aake  the  Bost  effective  ase  o' 
the  Baterials.    Significant  learning  gains  were  foond  for  the 
adaptive  Incentive  strategy  over  the  standard  Incentive  strategy 
(equal  distribution  of  points). 

The  Bost  powerful  application  of  the  aodel  can  be  reaUied 
through  a  CAl  srstes  which  updates  the  Instructional  prescriptions 
with  each  Individual  response  or  group  of  responses.  These 
ccBponents  create  an  "Intelligent"  system  that  varies  the 
aaterlals  as  learner's  needs  change  during  the  course  of 
instruction. 

Conteit  Models 


A  concern  related  to  adapting  Juiu  nuch  is  learned  to 
Individuals  Is  to  vary  Mini  Is  learned.    The  specific  Interest 
leading  to  the  developnent  of  this  latter  Bodel  was  the  student's 
difficulty  In  solving  sath  story  probless  (National  Assessment  of 
Education  Progress*  1979).    Vhen  the  theses  of  the  probless  are 
abstracti  unreallstlCi  or  highly  technicals  the  learner  Is  faced 
with  the  difficult  task  of  translating  the  seanlng  of  the 
unfaslllar  words  and  procedureSi  and  then  perforslng  the  necessary 
coBputatlons  to  arrive  at  the  answer.    The  objective  of  this  model 
wab  to  adapt  the  probles  conteite  to  the  learner's  Interests  to 
proBote  Beanlngful  learning. 

iMDiaaantitifln     The  conteit  Bodel  has  been  Isplesented  In  a 
PSl  course  (Ross*  1963)  and  on  a  CAl  lesson  (Anandi  198S).  The 
first  iBplesentatlon  Involved  the  development  of  conteit  eiasples 
related  to  the  background  of  the  learnersi  who  were  all  educatorsi 
In  a  statistics  course.    Meanlngfuli  educatlonally*related 
referents  such  as  teacherSi  studentSi  and  hosework  were 
substituted  for  the  abstract  referents  of         "Y\  etc.  (Ross* 
1983).    In  other  tests  of  the  sodeli  the  conteit  was  personallxed 
to  the  preferences  and  environment  of  the  Individual  learners  as 
obtained  fros  questionnaire  responses.    This  Information  was  then 
stored  as  data  In  a  coaputer  program  written  In  BASIC.  Problem 
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""tenpUtes"  were  stored  within  the  program  which  coald 
Incorporate  the  learner's  data  to  personallie  the  conteit.  For 
exaaplei  If  a  student's  favorite  food  was  pliia  and  hr  had  three 
frlendSi  Blllfi  Joe*  and  Saa;  the  prograa  would  present  a  problen 
asking  how  he  would  divide  the  plxia  between  these  friends  and 

hlBSI^lf  . 

nsanitg     In  one  stndfi  Soss  (1983)  presented  edacators  In  a 
PSI  coarse  with  Instrnctlof*  Incladlng  context  examples  related  to 
education  (adaptlve-edacdtlon  context).    A  second  group  received 
Instrnctlon  with  exaaples  froa  aedlclne  which  sabstltrted  doctors* 
nurses,  and  patients  for  the  referents.    A  third  groop  received 
abstract  exaaples  vslr.g  the  referents  of  "X",  "Y"i  "Event  A",  etc. 
The  resQlts  Indicated  that  the  adaptlve*9dacatlon  context  group 
perforaed  slcnlf Icantlf  better  than  the  non-adaptive  aedlcal 
context  group  and  the  abstract  context  groop.    Horses  were  used  In 
a  second  stadf  to  deteralne  If  the  resalts  were  due  to  the 
exasples  presented  In  the  educational  context*  or  to  the 
adaptive-context  strategr.    The  nurse  saaple  perforaed  best  with 
■edlcal-related  contexts.    These  results  were  consistent  with 
first  studr  Indicating  that  relatedness  of  context  to  student 
background  comprised  the  critical  factor  for  learning. 

In  a  third  studr,  Anand  (198S)  Investigated  the 
personalisation  of  the  context  as  an  adaptive  strateg?  with  fifth 
and  sixth-grade  students  In  a  aath  class.    The  first  treatment 
consisted  of  abstract  contexts  using  teras  such  as  quantltf, 
fluid,  units  and  so  on.    The  second  treataent    consisted  of 
concrete  context  exaapleo  that  used  realistic  hfpothetlcal 
referents  (e.g.,  Mrs.  Salth,  orange  Juice,  etc.).    The  third 
treataent  consisted  of  personallied  context  exaaples  generated 
froa  the  personal  data  collected  prior  to  the  Instruction  (e.g., 
best  friends,  favorite  food,  blrthdaf,  etc.).    Results  Indicated 
that  the  personallied  context  group  perforaed  significantly  better 
than  one  or  both  coaparlson  groups  on  aeasures  of  conventional 
problea  solving,  transfer,  foraula  recognition,  and  task 
attitudes. 


The  third  model,  context  density,  focuses  on  systeaatlc 
variations  of  mrriiHw  tatt  as  an  adaptive  strategy.  Our 
Interest  In  Investigating  this  strategy  Is  to  tailor  the  context 
or  text  explanations  to  learner's  needs,  and  to  the  attributes  of 
the  aedlua  (specifically,  coaputer  versus  print)  to  enhance 
coaprehenslon  and  perception.    Perception  concerns  the  learner's 
attitude  towards  the  Instruction  based  on  prior  knowledge 
(Johanstn  i  Tennyson,  1983). 

The  context  density  aodel  builds  on  the  support  aodels 
previously  described  and  other  related  studies  (e.g.,  Rothen  4 
Tennyson,  1978).    The  current  aodel,  however,  differs  froa  the 
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SQPPort  models  vhici  focvd  oa  tie  tke  lore  United  property  of 
imaber  of  eiasples  presented.    C04teit  densiiy  Ktnifests  itself  la 
sentence  or  pbrase  lensth*  desret  of  eliborition  end  redQndency« 
anoont  of  conteitnal  snpporti  and  linkages  bttwten  saior  concepts. 
This  Bodel  provides  a  Mans  for  restrictiring  tke  teit  by  larying 
conteitoal  density  to  meet  individial  needs  without  loss  of 
coBprehension  as  siggtsted  by  Jehansen  and  Tennyson  (1983).  Ve 
have  hypothesised  that  learners  with  a  high  learning  aptitude  or 
prior  subject  Batter  eiperience  aay  be  able  to  learn  aore 
efficiently  froa  a  less  dense  narratiie  withont  loss  of 
coBprehension.    Siailarly,  learners  with  lowtr  aptitsde  or  no 
prior  background  aay  rtqnire  a  aore  denst  narrative  as  conteitnal 
support  for  the  inforaation  to  be  learned.    This  hypothesis  is 
consistent  with  current  scheaata  thtori(»8  (Andersoni  1984; 
Rnaelhart  4  Ortony«  1977)  which  siggtst  coaprehension  is 
facilitated  by  eiisting  knowltdgt  strsctnres.    Variations  oi 
conteit  density  as  an  adaptive  strategy  conld  possibly  aeet  the 
varying  needs  of  the  Itarners. 

A  second  area  of  inttrest  with  the  conttit  density  aodel  is 
the  inttraction  with  prestntation  aode*-coap«ter  verses  print. 
This  interest  in  optiaal  ose  of  instrnctional  aethodologieSi  sot 
the  delivery  of  the  instrnctioni  is  consistent  with  Clark's  (1983? 
proposal  for  rtsearch  with  the  aedia.    Are  there  possible 
interactions  with  the  different  conteit  densities  (i.e.*  high  and 
low)  and  presentation  aode  die  to  delivery  systea  constraints  or 
attributes  that  will  enhance  or  bindtr  coaprehension?  For 
eiaaplOi  what  are  the  tfftcts  of  the  rednction  of  the  CRT  screen 
presentation  to  only  24  lines  by  40  or  80  colnanSi  or  the  lack  of 
traditional  cieing  aechanisas  snch  as  bold  and  italic  teiti  and 
underlining?    Is  there  an  eipectation  on  the  part  of  the  learner 
to  "see"  less  inforaation  on  the  CRT  screen  and  aore  on  a  printed 
pagoi  thns  requiring  aore  effort  on  the  learner's  part  to 
coaprehend  the  aessage  prtsented  on  the  CRT  screen? 

iMUMntttiiifi     In  onr  initial  stndVi  two  foras  of 
instroction  were  developed  ssing  a  section  froa  a  self-instruction 
statistics  book  developed  by  one  of  the  authors.    The  low  density 
version  was  developed  according  to  a  systeaatic  algoritha  for 
deleting  eitraneons  and  repetitions  aaterial  in  the  high  density 
teit  (original  version).    The  stiaslns  aaterial  consisted  of 
textbook  and  coapnter  versions  of  the  low  and  high  density 
presentations.    The  coapnter  vcrsioni  written  in  Apple  Snperpilot. 
allowed  the  stndent  to  refer  buCk  to  previons  screens  by  pressing 
the  6  key. 

Onr  pilot  stndy  consisted  of  print  and  coapnter  presentation 
aodes  with  either  hikh  density  narrativoi  low  density  narrativSi 
or  learner  control  of  narrative  density.    After    collecting  data 
on  35  subjects  (approiiaately  i  per  treataent)i  there  appears  to 
be  a  trend  for  learners  in  the  coapnter  aode  to  take  aore  tiae  in 
both  the  high-  and  low-density  treataents.    There  is  also  a 
tendency  for  the  subjects  in  the  coapnter  node  of  the  learner 
controlled  treataent  to  select  the  high  density  narrative  aore 
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often  than  subjects  in  the  print  node.    It  appears  that  learners 
in  the  coapater  aode  have  less  confidence  when  learning  froa 
inforaation  presented  via  a  CRT  screen. 

rotare  investigations  will  ase  context  density  as  an  adaptive 
strategy  to  present  high  or  low  density  narrative  according  to 
predicted  learner  needs  generated  with  the  aoltiple  regression 
Bodel  used  in  the  instructional  support  aodel.    Applying  the 
gene;:al  rule  for  the  sspport  aodeli  context  density  will  be 
increased  as  the  predicted  score  decreases;  and  context  density 
will  be  decreased  as  the  predicted  score  increases.  Planned 
extensions  include  the  refineaent  of  the  aodel  to  include  varying 
degrees  of  context  density  instead  of  the  two  discrete  levels  now 
used. 
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Figure  Caption 
Figure  1     Neaphls  State  regression  model 
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Introduction 

There  should  be  no  doubt  in  any  of  our  minds  that  the  computer  is 
a  useful  medium  of  instruction  and  that  it  is  potentially  an  unusually 
powerful  medium.     We  would  also  all  agree,  I  think,  that  our  knowledge 
of  what  to  do  with  the  computer  in  instruction  is  les^  than  perfect. 
I  do  not  believe  that  there  exists  a  body  of  prescriptive  knowledge 
which  tells  us  how  to  make  best  use  of  the  computer's  unique 
instructional  medium  characteristics  when  designing  instruction  which 
will  be  delivered  by  a  computer.     I  will  go  further  and  assert  that  we 
don't  even  know  much  at  all  about  instructional  design  that  takes 
advantage  of  what  a  computer  can  do  best.     This  paper  will  explore  one 
avenue  for  new  research  and  development  in  instruction:     use  of 
insights  from  the  study  of  teaching  for  development  of  intelligent 
instructional  software. 

Computers,  Teachers,  and  Other  Media 

I  believe  that  a  computer  is  more  like  a  person  than  it  is  like 
other  machines  with  regard  to  its  instructional  medium  attributes. 
"With  the  exception  of  the  teacher,  no  other  delivery  system  equals 
the  computer  in  its  potential  to  accommodate  the  needs  of  the 
individual  learner."   (Carrier,  1985,  p.   155)     Although  it  is  unusual 
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to  perforin  an  instructional  medium  attributes  analysis  of  human 
beingsr   it  is  possible  to  do  so ^  as  I  did  in  1982^  albeit  somewhat 
tongue  in  cheek,   (Pagan ^  1982)     When  a  human  is  used  in  the  role  of  an 
instructional  instrument^  we  call  that  instrument  a  "teacher,''  This 
use  of  humans  is  so  time-honored  and  commonplace  that  ^e  do  not  even 
consider  these  units  called  "teachers"  as  instructional  instruments  at 
allp  rather  thinking  of  these  "teachers"  as  one  major  means  of 
delivery  of  instruction  and  everything  else  being  either 
"instructional  instruments"  or  "aids"  to  a  teacher. 

There  are  many  attributes  of  a  human  which  may  help  make  him  or 
her  be  a  good  instructional  device ^  and  there  are  also  many  attributes 
which  make  a  teacher  less  than  ideal.     For  example^  humans  are 
notoriously  poor  at  being  able  to  do  something  on  one  day  in  exactly 
the  same  way  they  were  able  to  do  it  a  year  or  even  a  day  previously. 
This  lack  of  repeatability  makes  teacher  delivery  so  unreliable  that 
it  is  at  times  difficult  to  understand  how  the  use  of  "teachers"  could 
possibly  be  as  popular  as  they  are  in  schools^  disregarding  their 
expense  and  other  drawbacks. 

The  reason  why  the  use  of  "teachers"  is  mandatory  in  not  only 
schools  but  also  training  settings  can  be  boiled  down^  I  believe^  to 
their  enormously  powerful  information  processing  abilities.  Although 
not  perfect  by  any  means  (humans^  for  example^  have  a  severely  limited 
capacity  for  temporary  information  storage)^  humans  have  an  incredible 
capability  in  their  ability  to  do  what  they  call  "interact"  based  on 
information  processing.     Consider  this:     a  human  can  receive  what  a 
student  says  or  writes  in  natural  language  (this  is  called  "listening" 
and  "reading") ^  process  that  information  (with  humans^  they  call  that 
"thinking") ,  and  can  ask  a  question  or  provide  some  other  stimulus 
which  is  based  upon  what  the  student  said  or  wrote. 

Like  the  human^  a  computer's  primary  enviable  attribute  in 
instruction  is  information  processing  ability.    Were  it  not  for  that^ 
a  computer  would  be  a  poor  alternative  for  a  text  book  with  regard  to 
legibility^  a  poor  alternative  to  35mm  slides  or  an  overhead  projector 
with  regard  to  graphic  display^  and  a  poor  alternative  to  film  and 
video  with  regard  to  providing  animation.     Although  there  are  ways  to 
improve  a  computer's  performance  in  all  of  these  areas^  we  don't  use 
computers  due  to  their  fabulous  display  capabilities.     We  use 
computers  because  of  their  information  processing  capabilities. 

When  we  try  to  use  a  computer  in  a  manner  like  that  which  older 
media  such  as  text^  video ^  or  programmed  instruction  could 
deliver — the  automat ic-page- turner  sort  of  CAI — our  efforts  may  be  met 
with  success  in  terms  of  student  learning  but  we  find  we  are  open  to 
scathing  criticism  for  not  making  use  of  the  computer's  capabilities. 
And,  regardless  of  whether  other  people  criticize  us  or  not,  we  know 
that  all  we  have  accomplished  is  to  provide  effective  instruction  in 
an  area  which  can  be  provided  with  equal  effectiveness  through  other 
means  while,  at  the  same  time,  topics  abound  within  our  curriculum 
which  are  veritable  killtrs— -learning  tasks  which  only  the  most 
advantaged  students  fully  master,  leaving  the  remainder  of  the 
class — which  in  many  cases  is  the  majority — with  limited  success  or 
complete  confusion.     It  is  these  topics,  the  killers,  that  remind  us 
that  computers  are  supposed  to  be  wonderful  instructional  instruments. 
But  as  we  conceive  of  computer-delivery  of  instruction  which  is 
further  and  further  from  that  which  may  be  delivered  by  text,  video, 
or  programmed  instruction,  we  find  ourselves  as  instructional 
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designers  conceptually  further  and  further  away  from  anything  we  know 
IF  ich  about. 

If  it  is  tzu9,  es  I  am  saying,  that  we  yet  further  and  further 
from  the  center  of  our  bose  of  knowl  dge  and  tools  in  instructional 
design  when  we  attempt  to  design  instructional  software  which  makes 
effective  use  of  the  computer's  unique  -attributes,  what  field  of 
knowledge,  if  anything,  might  we  find  ourselves,  getting  closer  and 
closer  to?    Recall  that  earlier  we  noted  an  instructional  medium  which 
resembled  computers  in  that  its  strength  lay  in  ability  to  process 
information — the  use  of  humans  or  "teachers."    There  is  a  field  of 
study  related  to  that  one  approach  to  the  delivery  of  instruction  and 
that  field  is  called  "the  -tudy  of  teaching." 

The  Study  of  Teaching  and  the  Study  ,£  Instruction 

The  study  of  teaching  is  considerably  separate  from  the  rtuc*  of 
instruction.     A  good  general  term  for  what  most  of  our  rescMrcb 
instructional  technology  relates  to  is  "the  study  of  instruction. 
But  the  research  and  theory  interests  of  a  teacher-educat jr  or  a 
professor  of  Elementary  Education  or  of  Teaching  Methods  in  a  subject 
area  such  as  mathematics,  language  arts,  reac  "ng,  or  social  studies, 
will  most  likely  be  in  the  area  and  traditions  of  the  study  t ' 
teaching  (not  the  stady  of  instruction).     Your  colleague  who&e  primary 
umbrella  professional  organization    s  not  AECT  bui,   is  ASCD 
(Association  for  Supervision  an  Curriculum  Development)   and  who  always 
has  a  difficult  time  understanding  what  it  is  that  you  actually  do 
will  probably  have  a  primary  background  und  interest  in  teaching 
research.     By  the  same  token,  it  is  fair  to  say,  I  believe,  that  you 
have  an  equally  difficult  time  understanding  what  that  colleague  does. 

My  conclusion  from  the  above  this:     if  the  ways  in  «;/hich  teachers 
effectively  conduct  instruction  are  different  and  in  certain  ways 
better  than  other  media,  and  if  teachers  and  compui-   s  share  the 
critical  capabilities  of  intelligent  i  iformation  pi     *ssing,  then  two 
things  may  be  predicted: 

1.  that  the  study  of  instruction,  being  devoted  in  the  main 
to  instruction  delivered  by  non- intell igent  instruments,  would  not 
include  research  and  theory  regarding  what  to  do  with  an  intelligent 
instructional  instrument,  and 

2.  that  the  study  of  teaching,  being  devoved  in  the  main  <.o 
instruction  delivered  by  intelligent  entities   (humans),  should  include 
research  and  tneory  regarding  what  to  do  with  an  intelligent 
instructional  instrument,  the  computer. 

artificial  Intelligence  and  Instructional  Design 

My  interest  in  the  current  topic  did  not  ben  -j  with  artificial 
intelligence  (AI),  but  I  have  realized  over  the  t»ast  year  that 
concern  with  teaching  research  in  the  context  of  instructional  design 
for  CAI,  would  lead  quite  naturally  into  contributions  toward  design 
of  intelligent  instructional  software.    Although  I  see  little 
recognition  of  it  in  our  literature  as  of  yet,        methods  and 
techniques  have  already  been  developed  which  have  enormous  potential 
in  instruction,   (Schank,  19b4)  and  there  is  good  rf»ason  to  believe 
that  education,  specifically  the  delivery  of  instru^-tion ,  will  be  one 
of  the  most  important  uses  of  AI   in  th-*  near  future.  "Automated, 
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intelligent,  individual  instructors  are  one  of  the  most  interesting 
and  socially  significant  possible  applications  of  AI."  (Schank,  1984, 
p.  205)     Although  the  potentials  appear  to  be  enormous,  and  a  number 
of  people  have  noted  to  me  their  interest  in  the  area,  it  does  not 
appear  that  anyone  knows  much  about  design  of  what  I  will  call 
"intelliqent  instructional  software"  or  "IIS."    Not  only  do  we 
instructional  technologists  know  little  about  IIS  design,  our 
counterparts  in  computer  science  appear  equally  unready.     Fot  example, 
Rooer  Schank,  whose  work  in  artificial  intelligence  at  Yale  University 
IS  discussed  in  The  Cognitive  Computer  (Schank,  1984),  appears  as 
naive  about  instruction  as  anyone  could  possibly  be  in  his  discussions 
of  uses  of  artificial  intelligence  in  instruction.    For  example. 

If  today's  teachers  were  watching  each  child  carefully,  they 
could  vary  the  complexity  and  amount  of  the  examples  in  the 
books  so  that  each  child  could  maintain  interas'c  according 
to  his  progress.     If  workbooks  were  smart  enough  they  could 
do  this  by  themselves.     But  workbooks  don't  know  whether  or 
not  a  child  is  doing  the  exercises  correctly,  or  how  far  he 
has  gone.    A  workbook  isn't  able  to  stop  him  in  the  middle 
of  page  54,  exercise  D,  problem  13,  and  say.  No,  you've 
missed  something,  let's  go  back  to  that  tricky  problem  on 
page  50.     Nor  can  it  say  Greatl     You've  got  the  hang  of  it. 
Let's  go  on  to  something  else.    Think  of  how  alienating  and 
dehumanizing  the  grade-school  textbooks  and  the  instruction 
that  is  coordinated  with  them  really  are.     (Schank,  1984,  p. 
207)  ^ 

One  gets  the  impression  that  if  left  to  their  own  devices,  the 
computer  science/AI  community  will  do  little  more  than  re-discove-. 
programmed  instruction,  not  going  auite  as  far  as  re-discovery  of 
instructional  design. 

In  studying  instructional  strategies  in  CAI  and  in  thinking  about 
questions  of  the  design  of  IIS,  I  became  convinced  that  research 
findings  from  the  study  of  teaching  could  be  of  enormous  utility  in 
enhancing  our  knowledge  and  tools  for  design  of  instructional 
software,  both  conventional  and  intelligent.     Based  upon  this 
conviction  1  therefore  set  out  to  survey  the  research  and  theory  in 
the  area  of  the  study  of  teaching.     (Footnote:     in  this  effort  :•  am 
indebted  to  Prof.  John  F.  Wedman,  University  of  Northern  Iowa,  and  to 
Jo  Lynn  Digranes,  doctoral  student  in  educational  technology  at  the 
University  of  Oklahoma  for  their  suggestions  ar^  ideas.)     Rather  than 
attempt  a  full  summary  of  the  literature  in  the  study  of  teaching— an 
impossible  task  in  this  setting  in  any  event — I  would  like  to  present 
to  you  the  highlights  of  what  I  found,  recalling  if  you  will  that  I 
was  looking  'or  help  in  the  design  of  instructional  software. 

The  Study  of  Teaching  in  a  Nutshell 

The  people's  names  I  found  most  cited  and  recommended,  ana 
therefore  whose  writing  I  concentrated  on  in  my  survey  were:  David 
Berliner,  Philip  Hosford,  Christopher  Clark,  Robert  Yinger,  Barak 
Ro«'  nshine,  N.L.  C^qe,     and  Madeline  Hunter.     Topics  ar.d  key  ideas 
within  the  study       teaching  which  I  found  most  repeated  and 
emphasized    s  major  areas  of  interest  ^ere:  teacher  effectiveness. 
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teacher  thinking,  and  models  of  teaching.     Of  all  the  material  which  I 
read,  I  would  recommend  as  a  single  most  helpful  source,  Using  What 
We  Know  About  Teaching,  Edited  by  Philip  Hosford  and  published  by 
the  ASCd.   (Hosford,  198 4 ) 

The  following  areas  were  used  as  primary  organizing  topics  by 
Berliner  in  his  discussion  of  the  status  of  teaching  research 
(Berliner,  1984): 


A,  Pre-instructional  factors 

1.  Content  decisions 

2m  Time  allocation  decisions 

3,  Policy  decisions 

4,  Grouping  decisions 

5,  Decisions  about  activity  structures 

B,  Dur ing-instruction  factors 

1,  Engaged  time 

2,  Time  management 

3,  Monitoring  success  rate 

4,  Academic  learning  time 

5,  Monitoring 

6,  Structuring 

7,  Questioning 


C,  Climate  factors 

1,  Communicating  academic  expectations  for  achievement 

2,  Developing  a  safe,  orderly  and  academically- focused 

envi  ronment  for  work 

3,  Sensible  management  of  deviancy 

4,  Developing  cooperative  learning  environments 

D,  Post-instructional  factors 

1,  Tests 

2,  Grades 

3,  Feedback 


The  content  of  most  of  the  topics  is  descriptive  in  nature.  For 
example,  with  regard  to  content  decisions,  the  research  indicates  that 
the  factor  exists;  in  other  words,  that  teachers  do  in  fact  make 
content  decisions  from  time  to  time.    The  research  does  not  speak  to 
how  teachers  make  content  decisions  or  \ow  best  content  decisions 
should  be  made, 

Berliner's  summary  emphasized  for  many  topics  that  there  is  a 
great  amount  of  variability  among  teachers.     This  was  the  primary 
fikiding  summarized  for  time  allocation  decisions,  for  policy 
decisions,  and  for  activity  structures. 

For  the  remainder  of  the  topics,  the  primary  findings  noted  can 
be  characterized  by  "performance  of  this  function  is  correlated  with 
student  learning"  or  by  "teachers  who  do  this  more  than  most  teachers 
have  students  who  achieve  more  than  average."    For  example,  studies 
are  cited  which  indicate  that  there  is  a  strv ng  relationship  between 
success  rate  (how  often  the  learner  is  successful  on  things  like 
exercif^cs,  problems,  and  so  forth)   and  achievement.     Rather  than  note 
the  utility  of  instructional  instruments  such  as  programmed 
:nstruction  in  this  regard,  the  a  typical  conclusion  for  teaching 
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research  is  drawn:  "it  appears  that  the  classroom  in  which  the  teacher 
moves  rapidly  about,  monitoring  students  and  raising  the  number  of 
substantive  interactions  with  students,  is  the  class  where  students  do 
well."  (Berliner,  1984,  p.  62)     "A  substantive  interaction  between  a 
teacher  and  student  takes  place  when  the  teacher  checks  to  see  if  the 
student  is  doing  things  correctly,  asks  questions,  gives  the  student 
academic  feedback,  and  so  on."   (p.  62-63)     Both  tutorial  CAI  and 
programmed  instruction  do  this  sort  of  thing  routinely.     In  one  sense, 
we  can  turn  this  area  into  a  design  recommendation,  albeit  not  too 
innovative  one:  "CAi  software  should  be  designed  so  that  it  checks 
student  work  for  accuracy,  that  it  asks  questions,  and  that  it  provide 
feedback."    On  the  other  hand,  a  question  presents  itself  for  which  we 
do  not  have  a  ready  answer:  what  difference  does  it  make  to  have  a 
human  do  these  things?    If  it  is  the  case  that  a  human  is 
needed,  what  are  the  critical  variables?    Are  there  particular 
behaviors  that  only  humans  can  produce  (at  present)?    If  so,  an  expert 
system  protocol  analysis  of  teacher  monitoring  behaviors  would  appear 
needed  if  we  are  going  to  get  into  AI  in  instruction.    Or  is  the 
critical  factor  not  what  the  teacher  does  but  what  the  teacher  is:  a 
person.     If  that  is  the  case,  in  what  regard  does  the  student's 
knowledge  that  the  teacher  is  a  person  make  a  diff€»rence? 

In  another  review,  Hosford  (1984)  summarizes  the  "science"  of 
teaching  to  be  found  in  five  factors: 

T  -  time  on  task  (sufficient  amount) 

E  -  expectations  (projection  of  high  expectations  for 

learning) 
M  -  monitoring  student  progress 

P  -  problems  assigned  (individual  work  which  can 

be  done  individually) 
0  -  organization  (manage  class  so  well  that  discipline 

is  not  problem) 

The  "art  of  education"  is  sc?en  in  teacher's  fostering  and 
characterization  of  what  Hosford  calls  the  "silent  curriculum" — four 
broad  areas,  three  of  which  are  ignored  by  a  school's  manifest 
curriculum,  but  associated  with  greatness  in  teaching: 

1.  desire  fOL  learning 

2.  improved  self -concept 

3.  respect  for  others 

4.  skill  in  vhe  use  of  the  3  R*s 

Teachers  who  can  impart  in  students  a  desire  for  learning,  who 
contribute  to  improvei:.ents  in  their  students'  self-concepts,  who  show 
a  respect  for  others  and  teach  their  students  to  do  so,  and  who  are 
themselves  highly  skilled  in  the  basics  and  improve  their  students' 
achievement  in  the  basics  are  what  Hosford  would  characterize  as  being 
"high  art"  teachers.     Teachers  who  are  good  with  regard  to  behaviors 
within  the  "science"  domain  he  would  characterize  as  "high  science." 
The  best  teaching  would  be  both  high  art  and  high  <?cience. 

Are  Hosford's  factors  the  sorts  of  things  we  can  emplov  in  design 
of  intelligent  instructional  software?    Although  Hosford's  factors  are 
quite  broad,  perhaps  they — even  the  "art  of  education"  factors — are 
areas  in  which  we  can  begin  some  productive  work.     If,  for  example, 

o 

ERIC 


7 


one  were  to  perform  a  protocol  analysis  of  teaching,  where  would  one 
start?    It  seems  only  reasonable  that  if  we  want  to  develop  principles 
for  intelligent  instructional  software,  that  we  should  begin  by 
focusing  investigations  on  the  areas  within  which  the  most  is  known 
and  which  are  considered  most  important  by  the  peoplo  whose  field  is 
research  into  the  phenomena  which  we  wish  to  model. 

In  another  review,  Bauman  (1984)  cites  nine  factors  of  teacher 
effectiveness,  reminiscent  of  those  we  have  already  seen: 


1.  clear  goals  and  objectives 

2.  allocated  time 

3.  academic  engaged  time 

4.  success  rates 

5.  management 

6.  monitorir.g 

7.  direct  instruction  (the  provision  of) 
instructional  organization 

9 •  classroom  atmosphere 


Similarly,  Rosenshine  (1983)  provides  six  functions,  from  six 
studies  of  teacher  effectiveness,  which  describe  what  effective 
teachers  do: 


1.  review  and  checking  previous  day's  work 

2.  presenting  new  content/skills 

3.  initial  student  practice  (and  checking 

for  understanding) 

4.  feedback  and  correctives   (and  re-teaching  if  necessary) 

5.  student  independent  practice 

6.  weekly  and  monthly  reviews 


Clark  and  Yinger  (19/7)  reviewed  research  on  teacher  thinking. 
This  work,  quite  different  from  the  work  on  teacher  effectiveness,  may 
be  relevant  to  requirements  and  specifications  for  intelligent 
instructional  software.     One  major  question  addressed  by  the  research 
on  teacher  thinking  is  that  of  interactive  decision-making.     It  had 
been  assumed  that  teachers  do  a  great  deal  of  decision-making  on  their 
feet,  as  it  were,  in  the  classroom.     The  research  indicates  that  they 
do,  but  not  much.     Teachers  consider  alternative  strategies  only  when 
things  are  going  poorly.     In  other  words,  teachers  apparently  do  not 
make  efforts  to  optimize  learning.     Student  participation  and 
involvement  are  the  primary  cues  used  by  the  teacher,  and,  in  fact, 
teachers  rarely  change  their  strategy. 

Another  facet  of  the  teacher  thinking  research  reviewed  by  Clark 
and  Yinger  is  the  content  of  teachers'   "interactive  thoughts."  (p. 
294)     Teachers  apparently  think  about  present,  past,  and  future  issues 
while  interacting  with  students.     Teacher  thoughts  about  the  present 
are  primarily  about  student  behavior  and  their  own  affective  state. 
Teacher  thoughts  about  the  last  are  concentrate  on  reflection  on  past 
events  within  the  present  lesson,  retrieval  of  factual  information 
such  as  oetsonal  information  about  particular  students,  curriculum 
content,  principles  of  teaching,  and  beliefs  about  children  (learner 
characteristics).     Finally,  teacher  thoughts  about  the  future  are 
primarily  on  tactics  to  be  used  next  in  the  current  lesson, 
predictions  or  visualizations  uf  directions  the  lesson  might  take,  and 
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expectations  for  student  behavior  and  student  learning  of  objectives. 

The  research  on  teacher  thinking  may  be  a  good  place  to  begin 
when  determining  information  processing  requirements  and  structures 
for  Al-based  intelligent  instructional  software. 

Finally,  I  would  like  to  present  a  key  point  or  two  from  an 
individual  study  rather  than  a  review.     The  study,  Yinger  (1980),  was 
a  single-subject  study  of  teacher  planning.     The  aspect  of  the  study 
which  I  found  of  most  interest  was  the  investigator's  report  of  the 
teacher's  use  of  "routines."    These  "teaching  routines"  were 
mechanisms  used  to  establish  and  regulate  activities  and  to  simplify 
planning.     Four  types  of  routines  emerged:     1.  activity  routines,  2. 
instructional  routines,  3.  management  routines,  ^.nd  4.  executive 
planning  routines.    These  teacher  routines  appear  to  have,  at  a 
superficial  level  at  least,  a  close  correspondence  to  general-level 
computer  system  activity  descriptions. 

Conclusions  from  Teachinc^  Research 

When  I  began  my  survey  of  teaching  research,  I  had  hoped  that  I 
would  find  prescr iptively  oriented  theories  and  models  of  what 
effective  teachers  do  and  how  they  do  it,  similar  to  instructional 
design  theories  and  models  but  with  reference  to  teachers  rather  than 
materials  or  systems.     I  hoped,  particularly,  to  find  analyses  of  the 
nature  of  interaction,  questioning,  and  feedback.     I  did  not  find  what 
I  hoped  for.    Although  I  do  not  claim  my  survey  of  teaching  research 
reviews  to  be  an  in-depth  review  itself,  I  think  this  survey  fairly 
grasps  the  nature  and  quality  of  the  mainstream  of  recent  research  on 
teaching.     Perhaps  another  survey  of  the  research  on  teaching  should 
be  performed,  this  one  not  focusing  on  the  recent  research  but  on 
finding  useful  information  in  v^hat  appear  to  be  areas  of  most 
potential:  interacti'         jestioning,  and  feedback, 

I  have  noted  eai  while  discussing  various  reviews,  that  the 

possibility  exists  of  using  some  of  the  work  reviewed  as  a  beginning 
point  for  protocol  analysis  for  development  of  expert  systems.  I 
would  like  to  expand  that  idea  and  suggest  that  instructional 
researchers  may  wish  to  begin  to  study  teaching  themselves.     This  new 
study  of  teaching  would  build  upon  the  existing  literature  but  would 
proceed  along  new  directions.     In  other  words,  if  what  we  need  isn't 
there,  we  may  have  to  do  it  ourselves,    we  will  have  to  study  teachers 
and  teaching  to  establish  protocols  for  our  "automated  teachers."  In 
so  doing,  we  will  not  only  need  to  begin  where  the  current  work  leaves 
off  (irather  than  painfully  rediscover  the  wheels  of  teaching  research) 
but  also  we  may  find  the  skills  and  perspective  of  seasoned  teaching 
researchers  to  be  invaluable. 
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ABSTRACT 


An  examination  of  the  evaluation  of  media  services  In  a  school 
of  nursing  utilizing  qualitative  research  methodology  Is  presented. 
Since  ethnographic  methodology  dlfferes  significantly  from  research 
approaches  more  commonly  used  in  education,  it  is  important  to  Identify 
and  understand  the  differences  in  this  alternative  approach.  This 
study  considers  these  differences  and  provides  an  application  of 
this  methodology  in  the  evaluation  of  media  support  services  with^i 
a  school  of  nursing.    Pertinent  evaluation  and  ethnographic  literature 
are  reviewed  to  provide  a  theoretical  basis  for  this  discussion. 

A  one  year  prototypical  study  employing  ethnographic  methodology 
was  undertaken  to  evaluate  media  services  within  a  school  of  nursing. 
Objectives  were  established  in  the  areas  of  needs  assessment  and 
evaluation  of  the  condition  and  context  of  media  services.  Data 
was  collected  through  interviews  with  and  attendance  at  faculty  committee 
meetings,  Informal  observation  and  interaction  with  nursing  faculty, 
students  and  administrators,  observation  of  the  process  of  media  support 
services,  collection  of  media  utilization  data  and  the  establishnent 
and  maintenance  of  contact  with  university  level  media  personnel,  both 
formal  and  informal. 

Media  and  instructional  support  needs  were  identified  and  classified 
in  four  areas.    These  categories  were:  (1)  Organization,  (2)  Administration, 
(3)  Service,  and  (4)  Production. 

Recommendations  are  specified  on  the  basis  of  examined  conditions 
relative  to  the  four  categories  of  need.    Plans  for  action  and  future 
development  direction  emerged  from  the  analysis  of  qualitative  data. 


INTRODUCIION 


Evaluation  of  media  support  services  is  both  assumed  and  system- 
atically planned  for  in  the  on  going  process  of  media  services  manage- 
ment (E-lckson,  1968).    Moreover,  A.E.C.T.  (1982)  suggests  that  in 
addition  to  quantitative  factors,  qualitative  considerations  may  be 
necessary  to  effectively  evaluate  specific  programs  of  media  support. 
Therefore,  the  purpose  of  this  study  is  to  Identify  qualitative  research 
methodologies  which  are  suitable  for  evaluation  of  media  support  services. 
Furthermore,  an  ethnographic  approach  is  then  applied  to  the  evaluation 
process  of  media  services  in  a  school  of  nursing. 


REVIEW  OF  THE  LITERATURE 


Three  areas  of  consideration  emerge  from  a  review  of  the  evaluation 
and  media  support/educational  technology  literature.    The  three  areas 
are:  (1)  Issues  of  research,  (2)  Considerations  related  to  the  natural- 
istic paradigm,  and  (3)  Ethnographic  methodologies.     Issues  of  research 
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Include  considerations  of  paradigmatic  differences,  questions  of 
methodology  and  the  resolution  of  apparent  differences. 

Paradigmatic  differences  have  been  addressed  by  Cuba  (1981), 
Cuba  and  llncoln  (1931)  and  Cuba  and  Lincoln  (1982),  relative  to 
defining  naturalistic  Inquiry.    Essentially  for  research  purposes, 
paradigms  may  be  viewed  as  patterns  for  discovering  knowledge. 
Therefore,  different  paradigms  rest  on  different  philosophical 
foundations  with  varying  sets  of  assimptlons  relative  to  the  research 
phenomena  in  question  (Donmoyer,  1985;Guba  and  Lincoln,  1982).  Hence, 
due  to  differences  in  world  view,  varying  paradigmatic  approaches  have 
in  fact,  produced  a  heated  debate  both  philosophically  and  operationally. 
Most  notably  has  been  the  discourse  between  "rationalistic"  and 
"naturalistic"  means  of  Inquiry  (Howe,  1985) . 

Philosophical  stances  have  lead  to  percel/ed  differences  in  method- 
olog^'.    Methodological  differences,  according  to  Cuba  (1981)  have  been 
viewed  In  terms  of  quantitative  versus  qualitative  preferences.  How- 
ever, Cuba  (1981)  further  suggests  that  methodology  concerns  are  better 
analyzed  when  viewed  in  relation  to  the  trustworthiness  of  the  results 
which  those  methods  yield.    Hence,  when  viewed  In  relation  to  aspects 
of  trustworthiness  (ie.:  truth  value,  applicability,  consistency  and 
neutrality),  questions  of  validity,  reliability  and  objectivity  from 
a  '^rationalistic"  perspective,  may  in  fact  find  a  commonality  of 
agreement  when  defined  in  terms  of  credibility,  dependability  and 
conflrmabUity,  from  the  "naturalistic"  perspective. 

Moreover,  Cook  and  Relchardt  (1979)  suggest  that  a  resolution  to 
the  "ratlonalistlc"/"naturall8tlc"  debate,  on  at  least  the  methodological 
level,  is  the  use  of  both  qualitative  and  quantitative  methods  where 
appropriate.    Hence,  Cuba  (1981)  and  Guba  and  Lincoln  (1982)  propose 
the  triangulation  of  -methodology  through  the  collection  of  data  from 
both  perspectives. 

The  second  major  area  of  consideration  relative  to  the  literature 
review,  is  that  of  analyzing  aspects  of  the  naturalistic  paradigm.  This 

analysis  may  be  viewed  in  terms  of  the  two  areas  of  philosop^^ical 
assumptions  and  methodology  considerations.    There  are  five  areas  of 
philosophical  assumption  relative  to  the  naturalistic  paradigm  (Guba,  1981; 
Guba  and  Lincoln,  1982).    First,  Guba  (1981)  suggests  that  there  are 
multiple  realities  which  may  in  fact,  be  studied  holistically.  Second, 
the  researcher  and  object  or  "respondant"  have  an  interactive  relationship, 
with  each  influencing  the  other.    Third,  generalizations  are  not  possible 
due  to  the  fact  that  knowledge  is  bound  both  by  time  and  context.  Forth, 
since  actions  are  best  explained  in  terms  of  the  interaction  of  multiple' 
factors,  methods  of  assessing  phenomena  are  most  appropriately  deter- 
mined by  the  notion  of  "best  fit,"  relative  to  a  contextual/holistic 
approach.    Fifth,  the  research  endeavor  (inquiry)  is  value  bound.  These- 
five  areas  of  philosophic  assumption  Impact  methodological  applications 
for  the  practicing  evaluation  researcher. 

Methodological  considerations  would  include  a  wide  variety  of  data 
gathering  techniques.    Guba  and  Lincoln  (1982)  suggest  a  number  of 
techniques,  such  as  inLerviewing ,  observation,    record  analysis  and 
non-verbal  cueing  behaviors.    Moreover,  Patton  (1980)  and  Van  Maanen  (1983) 
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both  address  a  number  of  related.  Issues  dealing  with  the  application 
of  and  collection  of  data  by  qualitative  methodologies.  While 
quantitative  methods  as  identified  by  Campbell  and  Stanley  (1963) 
may  also  be  Included  in  the  research  design  in  order  to  triangulate 
findings  (Cook  and  Relchardt,  1979).    Finally,  methods  may  in  fact 
be  determined  by  the  unfolding  of  the  study  according  to  Cuba  and 
Lincoln  (1982). 

Based  on  the  fore  going  considerations,  the  utilization  of 
ethnographic  methodological  approaches  appear  to  be  not  only  useful, 
but  also  highly  appropriate  to  the  evaluation  of  media  support  services, 
from  a  qualitative  perspective.    Wilson  (1977)  and  Fetterman  (1984) 
suggest  specific  considerations  for  the  use  of  ethnographic  techniques 
in  evaluation  research.    Accordingly,  Shrock  (1985)  notes  that  the 
results  of  naturalistic  studies  tend  to  be  process  oriented,  holistic 
and  personally/politically  sensitive. 

Therefore,  the  study  reported  herein,  is  that  of  a  one  year 
prototypical  study  employing  ethnographic  research  methodology  from 
a  naturalistic  perspective,  in  order  to  evaluate  media  services  and 
to  determine  areas  of  need  for  further  development  in  support  for  a 
school  of  nursing. 


The  methodology  section  of  the  study  includes  delineation  of  the 
context/institutional  setting,  as  well  as  data  collection  activities 
and  data  analysis.    The  delineation  of  the  institutional  setting  and 
contextual  considerations  provide  for  a  higher  degree  of  transferability 
of  results  by  providing  descriptive  data  which  may  be  compared  with 
other  settings  and  contexts  (Cuba,  1981).    Therefore,  this  study  took 
place  at  a  four  year  private  university,  within  its  school  of  nurs^'ng. 
The  school  of  nursing  offers  a  four  year  baccalaureate  program  in 
nursing  accredited  by  the  National  League  for  Nursing.    Nursing  students 
receive  Instruction  on  campus,  while  gaining  related  clinical  experience 
at  various  local  health  care  facilities.    An  intensive  program  of 
individualized  auto-tutorial  instruction  with  clinical  simulation 
laboratory  experiences  predominates  the  Junior  and  senior  levels. 
Several  graduate  programs  leading  to  a  Master  of  Science  degree  in 
Nursing  (M.S.N.)  are  also  offered,  as  is  a  course  of  studies  leading 
to  a  Doctorate  in  Nursing  Education.    Undergraduate  enrollment  is 
approximately  six  hundred  with  graduate  students  numbering  approximately 
two  hundred  and  twenty.    Combined  undergraduate  and  graduate  faculty 
total  approximately  fifty  five  (FTE) . 

Media  support  is  provided  through  a  specialized  nursing  media 
support  group  for  students*  individualized  instruction,  clinical 
simulation  laboratory  experiences  and  several  small  classrooms  within 
the  school  of  nursing's  building  space.    Classroom  support  outside  of 
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the  nursing  building  Is  provided  through  a  campus  wide  centralized 
media  center.    The  nursing  media  support  area  maintains  a  collection 
of  nursing  related  software  materials,  Instructional  kits  and  AV 
hardware.    These  materials  are  housed  in  a  small  closet  area  and 
are  checked  out  by  students  and  faculty  for  use  In  smallgroup  viewing 
rooms  located  throughout  the  nursing  building  space.  Instructional 
kits  for  clinical  simulation  laboratory  use  are  checked  out  and  used 
in  the  laboratories,  located  in  another  part  of  the  nursing  building. 
Staffing  consists  of  one  full  time  supervisor  (R.N.  with  no  formal 
media  training),  two  part  time  work-study  students  and  a  laboratory 
assistant  (part  time).    Faculty  are  primarily  responsible  for 
instructional  activities  utilizing  this  service. 

Guba  (1981)  suggests  that  by  collecting  "thick"  descriptive  data, 
a  higher  probability  for  transferlng  results  to  other  contexts  may  be 
achieved  due  to  the  comparison  "fit"  of  contextual  description.  There- 
fore, Issues  of  eternal  validity  and  generallzablllty  are  addressed 
from  a  naturaliitic  perspective  through  the  utilization  of  methods 
which  are  appropriate  for  determining  a  high  degree  of  transferability* 

Data  collection  activities  included  a  wide  variety  of  ethnographic 
and  naturalistic  methods,  as  well  as,  quantitative  measures.  Specific 
activities  Included:    observation  of  faculty  meetings  and  committee 
meetings;  structured  interviews  with  faculty,  students  and  administrators; 
Informal  observation  of  instructional  activities,  both  la  terms  of 
faculty  and  student  Involvement  and  interaction;  examination  of  faculty/ 
administration  generated  documents;  informal  conversations  with  faculty, 
students  and  administrators;  observation  of  the  process  of  media  support 
services;  collection  of  media  utilization  and  evaluation  data;  and  formal 
interviews  and  Informal  conversations  with  tiniversity  level  media 
support  staff  and  administrators. 

Observation  of  faculty  meetings  and  committee  meetings  provided 
data  for  log  entries.    Log  entries  Included  any  activities,  discussion 
or  disclosure  relative  to  media  support,  as  well  as,  reactions,  questions 
and  other  social  Interaction.    These  data  were  cross  checked  with  documents 
generated  by  the  various  committees  and  respective  administrators. 
This  activity  provided  a  level  of  credibility  relative  to  findings  (Guba, 
1981). 

Structured  interviews  with  faculty,  students  and  administrators 
were  conducted.    The  use  of  standardized  open-ended  interviewing  techniques 
(Pattop,  1980,  p.  202)  provided  a  reduction  in  bias  due  to  the  stand- 
ardization of  questioning  for  each  of  the  different  groups  interviewed. 

Informal  observation  of  instructional  activities  yielded  interesting 
responses  from  both  faculty  and  students  in  natural  contexts  and  settings. 

Examination  of  faculty  and  administration  generated  documents  served 
as  references  for  cross  checking  observatlonaldata  (Guba,  1981). 
Primarily,  these  documents  consisted  of  committee  minutes,  memoes, 
annual  reports  and  task  force  reports  to  accredlttlng  agencies. 

Informal  conversations  with  faculty,  students  and  administrators 
provided  additional  data  which  reinforced  observational  and  Interview 
data  (Patton,  1980,  p.  198). 
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Observation  of  the  media  support  process  provided  log  entries 
which  lead  to  an  understanding  cf  logistical  problems  and  processes. 

Collection  of  utilization  and  evaluation  data  provided  for  the 
trlangulatlon  of  data  from  a  quantitative  perspective  (Guba^  1981). 
This  process  assisted  in  the  cross  checking  of  data  and  Interpretations 
established  by  the  qualitative  methodologies. 

Formal  Interviews  and  informal  conversations  with  university 
level  media  personnel  tended  to  clarify  need  areas  identified  by 
faculty,  students  and  administrators  in  the  school  of  nursing.  Moreover, 
this  activity  provided  for  peer  debriefing  experiences  for  the  researcher. 

Member  checks  were  provided  through  the  process  of  combined  observation 
and  interviewing  of  the  various  population  groups  Involved  in  the  study. 
This  member  feedback  provided  for  the  possibility  of  higher  levels  of 
credibility  (Cuba,  1981), 

Data  analysis  emerged  from  and  in  conjxinction  with  the  data  collection. 
Specific  themes  relative  to  needs  and  development  direction  for  media 
support  services  were  identified.    As  related  themes  emerged,  they  were 
checked  In  terms  of  source  origination  and  multiple  response.    As  various 
population  group  and  techniques  identified  related  themes,  the  themes 
were  then  defined  in  terms  of  media  support  need  and  related  direction 
development.    For  example^  when  organizational  concerns  were  expressed 
by  the  three  groups  of  faculty,  students  and  administration,  the  cross 
checking  of  these  references  lead  to  the  emergence  of  organizational 
need  areas. 


RESULTS 


Based  on  the  data  gained  from  the  variety  of  methods  utilized, 
a  conceptual  structure  of  media  support  service  need  categories  emerged. 
Moreover,  recommendations  specified  on  the  basis  of  the  examined 
conditions  provided  a  structure  for  strategy  development  relative 
to  the  need  categories. 

The  conceptual  structtire  of  identified  needs  consisted  of  four 
areas.    The  four  categories  relative  to  media  support  are:  (1) 
Organization,  (2)  Admlxiibtration,  (3)  Service,  and  (4)  Production. 
Organizational  considerations  Included  better  organization  of  distri- 
bution of  hardware/software  materials  to  faculty  and  students;  structured 
individualized  learning  areas;  Identification  of  lab  practice  areas; 
and  establishment  of  comprehensive  indices  and  Inventories  for  collection 
holdings. 

Administration  concerns  Included  staffing,  funding  and  supervisory 
considerations.    Specifically,  questions  of  necessary  staffing  levels 
for  media/lab  support,  budgeting  process  development,  oversight  of 
student  simulation  experience,  responsibility  for  lab  supplies  and 
collection  maintenance  were  identified. 
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Service  needs  Included  areas  in  which  media  support  service 
would  be  able  to  support  faculty  in  the  Instructional  process 
through  the  utilization  of  Instructional  design,  development  and 
evaluation  principles  and  practices.    Specific  service  needs  included 
the  following :    faculty  orientation  to  the  possibilities  for  media 
utilization  within  the  Instructional  process;  identification  of 
media  users  and  opinion  leaders;  continued  development  of  the  hardware/ 
software  collections;  and  facility  consultation  for  Instructional 
design,  development  and  evaluation. 

Production  needs  included  specific  applications  of  technology 
to  the  instructional  process  In  order  to  further  achieve  a  broad* 
based  learning  environment  through  the  production  of  materials 
designed  to  meet  specific  learner  needs.    Specific  production  needs 
Included:    utilization  of  basic  graphics  production  for  media  design; 
video  programming  applications  to  instructional  tasks,  delivery  systems 
and  testing  strategies;    application  of  computer  technology  to 
competency  based  Instructional  strategies;  and  development  of  graduate 
level  Instructional  materials. 

Recommendations  were  then  developed  on  the  basis  of  the  present 
contextual  condition  of  media  support  service  need  categories. 
Organizational  procedures  for  the  effeclent  and  effective  function  of 
media  distribution  were  developed.    Administrative  recommendations 
were  specified  In  terms  of  staffing,  budget,  supervision,  procedural 
specification  and  collection  maintenance.    Role  function  of  media 
service  staff  was  Identified.    Service  recommendations  were  developed 
in  terms  of  Instructional  support  perspective  Including  areas  cf 
Inservlce  training,  identification  of  media  users/opinion  leaders, 
and  consultation  for  future  development  endeavors.  Production 
recommendations  emerged  directly  from  data  yielded  from  the  qualitative 
methodology. 

Staffing  considerations  evolved  from  the  specification  of  support 
recommendations.    Moreover,  cooperative  ventures  were  identified  relative 
to  university  level  library  and  media  support  departments.  Channels 
of  communication  were  identified  and  formalized. 


DISCUSSION 


The  present  one  year  study  sought  to  identify  qualitative 
methods  which  would  be  suitable  for  the  evaluation  of  media  services 
within  specific  conteits.    Moreover,  an  ethnographic  approe^ch  was 
then  applied  to  the  evaluation  process  of  media  services  in  a  school 
of  nursing.    Categories  of  media  support  need  then  emerged  from  the 
activities  of  data  collection  and  analysis.    These  need  categories 
provided  a  basis  for  developing  a  structure  of  recommended  development. 

The  process  of  evaluation  ij  on  going,  due  to  the  evolutionary 
nature  of  media  support:  bound  in  space/time  contexts.  Therefore, 
this  study  merely  serves  as  a  prototype  for  an  on  going  evaluation 
methodology  process  within  the  school  of  nursing.    Needs  must  continue 
to  be  Identified y  strategies  implemented  and  evaluation  undertaken. 
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One  must  not,  in  this  process  lose  sight  of  the  central  ^oal  of 
instruction.    Therefore,  future  directions  will  be  shaped  by 
emerging  needs  and  the  strategies  implemented  to  meet  those  needs 
provi-ed  by  the  continual  process  of  evaluation. 
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Abstract 

In  the  Spring  of  1983,  twenty-five  second  grade  students  frc.i  a  public 
elementary  school  in  Ne^;  Mexico  f-ad  their  regular  curriculum  supplemented 
with  the  experience  of  LOGO  computer  programming.  This  experiment  studied 
the  effectiveness  of  LOGO'S  turtle  raphics  in  providing  the  subjects  with  a 
mode!  of  systematic  thought  which  could  be  applied  and  measured  in  an  adapted 
Piagetian  problem  solving  activity.  The  study  also  investigated  LOGO'S 
effectiveness  in  teaching  certain  f«jndamental  geometric  concepts  to  children 
who  were  supposedly  not  developmental  ly  ready  for  such  material.  The 
treatment  consisted  of  each  child  receiving  approximately  one  hour  of  Terrapin 
LOGO  programming  on  the  Apple  microcomputer  each  week  for  three  months. 
The  structure  of  the  programming  experience  was  based  on  a  guided  discovery 
approach.  The  children  were  allowed  much  freedom  in  their  programming 
choices,  yet  they  were  motivated  to  pursue  formal  stage  thought  patterns  using 
a  carefully  planned  positive  reinforcement  technique.  Data  from  the 
experimental  group  were  compared  to  another  second  grade  classroom  in  the 
same  district  which  did  not  receive  any  LOGO  experiences.  The  experimental 
group  showed  statistically  significant  results  in  both  the  problem  solving 
measure  and  geometric  pencil  and  paper  test.  The  control  group  showed  no 
significant  change  in  either  case. 
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The  Effects  of  LOGO  on  Young  Children 


Introduction 

The  introduction  of  the  L060  programming  language  to  mainstream 
education  in  the  late  1970's  and  early  1980's  received  much  attention  and 
initial  praise.  Even  though  not  much  was  known  empirically  about  the  use  of 
LOGO  with  children  (Watt,  1982),  it  was  nonetheless  b.  ought  into  many 
classrooms  across  the  country  with  rushed  excitement.  Many  educators  facing 
the  responsibility  of  utilizing  the  growing  microcomputer  medium  turned  to 
this  innovative  concept  with  the  hope  of  providing  children  with  a  suitable  and 
profitable  educational  experience.  In  lieu  of  the  research  and  field-test  data, 
many  educators  to^k  the  word  of  a  small  group  of  scientists  and  theorists  at 
the  Massachusetts  Institute  of  Technology  (MIT)  that  children's  exposure  to 
'.OGO  could  possibly  yield  favorable  results  in  thinking  and  mathematical 
ability.  Furthermore,  it  was  contended  that  these  results  would  be  best 
achieved  given  a  revolutionary  break  from  the  traditional,  and  often 
admonished,  teacher  dominated  classroom  and  proceed  to  a  highly  child 
centered  eirvironment  (Papert,  1980).  This  educational  bandwagon  was  further 
encouraged  by  the  public's  insistence  that  education  begin  to  prepare  its  youth 
for  the  already  present  computer  age.  These  factors,  among  others,  have 
contributed  to  LOGO'S  somewhat  ubiquitous  reputation  as  being  possibly  the 
most  significant  educational  software  of  the  decade  (Lough,  1983). 

Confirming  evidence  of  LOGO'S  ultimate  educational  value  was  expected 
from  some  of  the  early  LOGO  projects  sxh  as  the  Brookline,  Massachusetts 
project  and  the  Lamplighter  project  in  Dallas.  Unfortunately,  these  projects 
did  not  provide  educators  with  convincing  evidence  of  LOGO'S  potential  and  the 

'  539 


argument  for  and  against  LOGO  continued  Recently,  however,  the  findings  from 
several  large  LOGO  projects,  such  as  the  Bank  Street  College  Project  in  New 
Yoric  and  the  University  of  Israel  Project,  have  cast  rather  dark  clouds  over  the 
LOGO  landscape.  These  studies  attempted  to  present  LOGO  to  children  in  the 
context  of  free  or  open  discovery  learning  as  advocated  t»y  Seymour  Papert, 
LOGO  S  principal  developer.  In  these  studies,  LOGO  failed  to  show  any 
significant  contribution  to  the  children's  problem  solving  or  mathematical 
skills  (Pea,  undated;  Leron,  1985).  In  another  study  completed  at  the 
University  of  Edinburgh,  Scotland,  LOGO  was  presented  in  a  more  traditional  and 
structured  way.  LOGO  was  substituted  for  the  regular  mathematics  curriculum 
and  was  taught  in  a  structured,  teacher  directed  way.  Here  again,  LOGO  did  not 
provide  a  superior  learning  environment  over  non-LOGO  instructional  methods: 
students  in  the  LOGO  group  did  not  perform  significantly  better  on  math 
achievement  tests  than  non-LOGO  math  students  (Howe,  O'Shea  &  Plane,  1979). 
These  results,  and  in  particular,  the  results  from  the  Bank  Street  College  of 
Education  "raise  serious  doubts  about  the  claims  made  for  the  cognitive 
benefits  of  learning  to  program,  particularly  h  LOGO"  (Pea,  undated,  p.  30-31 ). 
These  results  have  prompted  many  educators  to  call  for  a  halt  in  the  use  of 
LOGO  and  LOGO-like  experiences  in  *he  classroom  (Tetenbaum  &  Mulkeen,  1984). 
These  studies  support  a  contention  that  LOGO  has  failed  to  deliver  what  it  had 
promised. 

In  response  to  these  criticisms,  Papert  has  emphasized  that  LOGO  never 
promised  anything.  Instead,  he  supports  the  view  that  LOGO  is  part  of  a 
cultural  influence.  Considering  LOGO  by  itself,  without  associated  cultural 
factors,  is  devoid  o'  meaning  (Papert,  1985).  This  is  why,  according  to  Papert, 
it  is  fruitless  to  try  to  control  for  the  "LOGO  variable"  in  experimental  type 
research. 
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Paperfs  criticism,  although  perhaps  valid  to  a  certain  extent,  leaves  the 
concerned  educator  in  a  type  of  "damned  if  you  do  and  damned  if  you  don't" 
situation.  Educators  who  try  to  understand  Paperfs  perspective  and  attempt  to 
aspire  to  the  potential  of  LOGO  find  themselves  confronted  with  unimpressed 
curriculum  supervisers  demanding  supportive  data  whereas  researchers  are 
accused  of  contaminating  a  good  idea  with  their  experimentation  techniques. 
Ultimately,  educators  will  need  to  have  an  objective  measure  of  the  possible 
Influences  of  LOGO  and  LOGO-like  experiences  on  their  students  in  order  to 
justify  continuing  or  abandoning  the  cause.  These  decisions  will  need  to  be 
based,  at  least  in  part,  on  Information  gathered  through  experimental  research. 
Purpose 

The  purpose  of  this  paper  is  to  present  and  discuss  a  relatively  recent 
study  involving  the  experiences  of  young  children  who  used  LOGO  over  a  three 
month  period.  The  purposes  of  the  study  were  two-fold.  First,  it  hM  been 
claimed  that  people  who  engage  in  LOGO  programming,  or  other  similar 
languages  for  that  matter,  are  apt  to  better  develop  problem  solving  abilities 
(Papert,  1980)  due  to  the  nature  of  the  programming  taslcs.  Programming  with 
LOGO,  it  is  contended,  supports  a  systematic  structure  of  procedural  problem 
solving  where  large  problems  are  broken  down  into  smaller,  more  manageable 
"chunks".  This  study  sought  to  investigate  whether  or  not  young  children,  given 
the  experience  of  LOGO  programming,  would  acquire  more  problem  solving 
skills  and  be  able  to  demonstrate  those  skills  In  other  problem  solving 
contexts. 

The  second  problem  investigated  and  discussed  here  concerns  the 
potential  of  learners  to  gain  Incidental  mathematical  Insight  and  ability 
through  their  LOGO  programming  experiences.  These  skills  are  termed 
incidental  because  they  are  not  taught  directly  by  the  teacher,  but  are  acquired 


as  a  by-product  of  the  total  rrogramming  experience.  The  rationale  behind  this 
is  based  upon  the  structure  o?  LOGO  itself.  The  language  of  LOGO  is  a  language 
where  mathematics  is  communicated  between  the  learner  and  a  small 
cybernetic  anima'  ailed  the  "turtle".  The  learner,  in  his/her  physical  world, 
and  the  turtle  in  its,  share  many  important  traits.  The  two  most  important 
traits  that  they  share  are  position  and  heading  malting  the  turtle  body  syntonic 
with  the  child  (Papert,  1980).  In  addition,  since  the  child  is  able  to  identify 
with  the  turtle  through  these  physical  associations,  Papert  contends  that  the 
child  and  the  turtle  begin  to  share  a  type  of  cognitive  bond.  This  bona,  or  ego 
syntonic  relationship,  allows  the  child  to  project  his/herself  according  to  the 
perspective  of  the  turtle.  It  is  through  these  means  that  the  child  is  believed 
to  be  able  to  gain  mathematic  insight  not  readily  attainable  through  traditional 
means.  This  belief  becomes  even  more  interesting  when  the  learners  are 
especially  young,  as  in  the  second  grade.  According  to  the  child  development 
theories  of  Piaget,  the  preoperational  or  concrete  operational  child  does  not 
view  the  world  as  being  filled  with  rigid  and  fixed  shapes.  Rather,  the  child 
views  the  world  with  a  more  topological  perspective  where  lines  and  angles 
are  permitted  to  bend  and  flex  (Copeland,  1979).  Therefore,  the  second  problem 
to  be  discussed  here  is  whether  or  not  young  children  are  able  to  assimilate 
some  basic  geometric  concepts  and  the  notion  of  perspective  and  rigidity  even 
though  their  cognitive  development  dictates  a  more  topological  viewpoint. 

Methods 

Subjects 

Subject  in  the  experimental  group  consisted  of  25  second  grade  children 
from  a  regular,  public  school  classroom.  The  experimental  group  consisted  of 
15  boys  and  10  girls  with  ages  ranging  from  seven  to  nine  years  with  a  mean 
age  of  8.03  years.  The  control  group  also  consisted  of  an  Intact,  second  grade 
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classroom.  This  group  was  from  a  different  school  In  the  same  school  district. 
The  control  group  consisted  of  22  children:  1 1  boys  and  1 1  girls  whose  ages 
also  ranged  from  seven  to  nine  years  with  a  mean  age  of  7.82  years.  The 
rationale  for  using  a  control  group  was  based  upon  the  need  to  control  for 
maturation  effects  of  the  experimental  group  (Campbell  &  Stanley,  1963).  Tlie 
experimental  and  control  groups  were  selected  based  In  part  upon  the 
willingness  of  their  teachers  to  participate  and  other  more  restraining  factors 
typically  found  In  field-based  research  which  prevented  random  assignment  of 
subjects  to  the  treatment  groups. 
Materials 

The  treatment  given  to  the  experimental  group  was  the  experience  of 
programming  a  microcomputer  In  the  computer  language  of  LOGO.  Each  subject 
received  approximately  one  hour  of  LOGO  programming  each  week  using  the 
Terrapin  version  of  L060  on  the  four  available  Apple  !!♦  microcomputers.  These 
four  microcomputers  were  also  used  by  the  rest  of  the  school  s  population. 
Since  this  study  was  conducted  within  the  confines  of  a  public  elementary 
school  it  was  therefore  subject  to  all  of  the  limitations  inherent  in  this  type 
of  setting.  Although  this  quasi-experimental  design  malces  proper  control  of 
experimental  variables  more  difficult,  there  are  some  merits  to  be  considered 
For  example,  the  LOGO  learniiig  environment  created  here  is  probably  not  much 
different  from  those  to  be  found  in  schools  all  across  the  country  and  thus  the 
results  can  probably  be  more  easily  generalized  to  currwt  classrooms. 
The  LOGO  Leamlna  Environment 

Initially,  the  LOGO  experience  presented  to  the  experimental  group  was 
planned  to  conform  to  Papert's  "free  discovery"  or  humanistic  style  philosophy 
where  the  teacher  acts  as  a  facilitator  rather  than  a  fact  giver.  In  this  type  of 
setting,  a  teacher  who  is  well  acquaint9d  with  the  programming  or  "nuts  and 
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bolts"  aspects  of  LOGO  acts  as  a  facilitator  giving  the  child  advice,  informative 
feedback,  technical  assistance  and  other  "on-task"  information  whereas  the 
child's  role  Is  to  take  an  individual  learning  path  with  the  responsibility  of 
generating  ideas  as  well  as  the  bulk  of  the  creativity.  Shortly  after  the 
treatment  began,  however,  it  became  very  obvious  that  the  subjects  would 
require  much  more  time  than  the  three  months  allotted  to  even  begin  to  attain 
the  programming  level  thought  necessary  for  any  significant  differences  to  be 
detected.  For  this  reason,  it  was  necessary  to  develop  a  way  to  motivate  the 
subjects  to  progr  3s  in  a  quickened,  yet  consistent,  way.  So  Instead  of 
allowing  the  children  to  explore  with  the  turtle  with  total  freedom,  as  Papert 
advocates,  a  different  approach  was  used  which  still  provided  the  children  with 
much  freedom. 

A  series  of  activity  cards  was  prepared.  On  each  card  was  a  simple 
shape,  such  as  a  square.  If  the  child  successfully  recreated  the  shape  on  the 
computer's  monitor,  then  a  "chance  slip"  was  rewarded.  This  chance  slip  was 
put  into  a  jar  which  was  later  used  to  draw  for  prizes.  The  more  chance  slips 
in  the  jar  at  the  time  of  the  drawing,  the  better  the  chance  to  win  a  prize.  The 
shapes  on  the  cards  were  then  made  increasingly  more  complex.  The  skills 
learned  on  one  card  might  be  prerequisite  on  another.  (Copies  of  selected 
activity  cards  can  be  found  in  Appendix  I.)  This  building  block  method  of  skill 
development  along  with  the  reward  system  proved  to  be  extremely  successful. 
The  children  were  not  forced  to  complete  the  activity  cards,  just  merely 
coaxed.  Many  times  a  chance  slip  was  awarded  if  the  child  would  try  to  alter 
something  in  their  design  according  to  the  instructor's  directions.  This  was 
done  to  help  the  child  achieve  a  concept  which  otherwise  would  have  been 
missed.  This  "guided  discovery"  technique  has  worked  well  in  this  and  in  other 
LOGO  environments  occurring  in  typical  school  situations. 


After  the  child  successfully  completed  several  activity  cards  with  little 
difficulty,  the  child  would  be  encouraged  to  combine  these  shapes  to  make  a 
larger  figure.  Any  figure  created  by  the  child  which  was  composed  of  activity 
card  shapes  was  also  awarded  a  chance  slip.  This  encouraged  the  children  to 
record  successful  programming  code  in  a  notebook.  The  code  for  several  single 
shapes  was  often  used  with  little  modification  when  joined  together  to  create 
the  macro  design. 

The  control  group  received  no  such  L060  exposure  or  any  microcomputer 
experience  for  that  matter  during  the  time  of  the  study.  Although  the  two 
groups  had  different  teachers,  it  must  be  restated  that  both  were  in  the  same 
school  district  and  therefore  both  received  similar  Instruction  In  terms  of 
content  since  both  classrooms  had  similar  classroom  materials  apart  from  the 
computer  experience,  such  as  identical  textbooks  and  district  objectives. 
Dependent  Measures 

Evaluation  of  LOGO  in  classroom  or  other  settings  has  been  controversial 
among  LOGOs  promoters  and  critics.  Although  LOGO  enthusiasts  tend  to  reject 
the  notion  of  testing  In  any  LOGO  microworld,  the  problem  of  objective 
evaluation  remains.  Justifying  the  inclusion  of  any  major  curriculum 
component  requires  accounting  for  supposed  educational  gains  In  clear, 
objective  terms.  LOGO'S  effectiveness  and  potential  learning  and  instructional 
benefits  appear  to  be  centered  in  two  areas:  problem  solving  and  mathematics. 
These  two  areas  closely  resemble  the  distinction  between  crystallized  and 
fluid  intelligence  as  described  by  Catell  (1971 ).  An  objective  of  this  study  was 
to  examine  a  possible  evaluation  procedure  of  LOGO  which  considers  these  two 
facets  of  intelligence. 

There  were  two  dependent  measures  used  in  this  study.  The  first  was  a 
measure  of  problem  solving  ability  in  two  parts  and  t(.<f  second  was  a  paper  and 
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pencil  geometry  test.  Both  measures  were  administered  by  the  researcher  to 
the  experimental  and  control  groups  in  a  pretest/posttest  design. 

The  p(*oblem  solving  measure  is  a  quantitatively  derived  form  of  two 
classical  Piagetian  activities  used  originally  as  examples  of  problem  solving  in 
individuals  at  the  stage  of  formal  operations.  This  measure  was  presented 
individually  to  each  subject  in  each  treatment  group  in  two  parts.  One  part 
involved  a  combinatorial  task  and  the  other  a  permutation  taslc.  These  tasks 
were  chosen  as  a  possible  solution  to  the  conflict  of  evaluating  problem 
solving  due  their  historical  use  as  relative  indices  of  formal  thought  in 
Piagef  s  Theory  of  Intellectual  Development  (Copeland,  1979).  These  tasks 
were  then  supplied  with  a  scoring  technique  which  would  allow  them  to  be 
statistically  analyzed. 

In  the  combinatorial  activity,  the  child  was  shown  six  piles  of  different 
colored  markers.  The  task  was  to  arrange  the  markers  in  as  many  combinations 
of  pairs  as  possible.  It  was  strongly  emphasized  by  the  researcher  to  the 
subjects  that  no  repeated  combinations  could  be  permitted.  All  discovered 
combinations  of  the  possible  15  were  scored  one  point  each.  However,  one 
point  was  subtracted  for  each  combination  repeated  by  the  child  Fifteen 
points  was  the  highest  score  possible  with  the  lowest  possible  score  being 
zero. 

Each  subject  was  instructed  to  complete  the  task  involving  permutations 
in  a  similar  fashion.  The  child  was  shown  four  piles  of  different  shapes: 
squares,  triangles,  stars,  and  circles.  The  task  here  was  to  remove  one  shape 
from  each  pile  and  then  arrange  the  four  shapes  in  a  different  way  from  all 
previous  trials.  Again,  it  was  emphasized  to  the  child  that  all  of  the 
arrangements  must  be  found  with  no  repeats  permitted.  The  scoring  technique 
here  was  identical  to  the  combinatorial  activity:  repeated  arrangements  were 


subtracted  from  the  tc.al  sum  of  identified  permutations  with  24  being  the 
highest  possible  score  and  zero  the  lowest. 

Each  subject's  raw  score  for  this  measure  was  the  sum  of  the 
combinatorial  and  permutation  taslcs. 

The  measure  of  geometric  concepts  was  administered  in  a  group  setting 
to  each  of  the  treatment  groups  with  measurement  tools  such  as  rulers  and 
protractors  provided.  The  test  consisted  of  four  pages  (see  Appendix  II).  Page 
one  consisted  of  an  angle  recognition  activity  where  the  child  was  instructed 
to  select  the  proper  angle  from  a  group  of  four.  Page  two  also  dealt  with  the 
concept  of  the  angle.  The  subjects  were  given  an  angle  and  one  ray  of  another 
angle.  The  subjects  were  Instructed  to  draw  the  second  ray  In  such  a  way  that 
the  angle  formed  would  match  the  given  angle  Identically.  Additionally,  the 
given  rays  were  offset  somewhat  from  the  given  angles  so  that  the  child  had  to 
consider  the  task  from  a  different  perspective.  Page  three  dealt  with  the 
measurement  of  line  segments.  One  line  segment  was  given  with  the  child 
being  told  to  draw  another  line  of  exactly  equal  length.  The  starting  point  for 
the  child's  line  was  given  and  offset  in  such  a  way  as  to  require  the  child  to 
demonstrate  conservation  of  length.  The  fourth  page  also  dealt  with  the 
concept  of  the  angle.  Here  the  child  was  Instructed  to  Imagine  rotating  a  given 
figure  a  certain  number  of  degrees  left  or  right  and  then  to  point  to  the 
direction  in  which  it  would  be  facing.  This  task  resembles  more  closely  the 
activity  actually  involved  In  LOGO  programming.  Whereas  the  first  three 
geometry  test  pages  attempted  to  measure  far  transfer  of  LOGO'S  mathematical 
model,  the  fourth  page  was  designed  to  measure  one  near  transfer  component. 

Analysis  of  the  n^^X^ 

Problem  Solving 

An  analysis  of  the  experimental  and  control  groups"  pretest  means,  1 1.52 
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and  1 .27  respectively,  on  the  problem  solving  measures  using  an  Independent  t 
test  show  that  the  two  groups  means  were  statistically  similar,  i(45) « 
-.1588,  c<.01  in  problem  solving  ability  at  the  onset  of  the  study.  (See  table  1 
for  the  groups'  descriptive  statistics.) 

The  experimental  and  control  group  s  posttest  means  were  17.6  and 
10.59,  respectively.  The  analysis  of  these  means  using  an  inoependent  i  test 
showed  a  highly  significant  difference,  1(45) »  487,  |i<.01.  Therefore,  the  null 
hypothesis  can  be  rejected  and  the  conclusion  drawn  that  these  means  are 
statistically  different. 

An  additional  analysis  comparing  the  pretest  and  posttest  means  of  each 
group  using  dependent  1  tests  also  support  the  above  conclusion  (although  this 
is  not  the  preferred  statistical  technique).  An  analysis  of  the  experimental's 
pretest  and  posttest  means  show  a  highly  significant  difference,  ti2A)  =  49, 
B<.01,  whereas  an  analysis  of  the  control  group's  pretest  and  posttest  means 
show  no  Jiignificant  difference,  1(21) «  -.5718,  a<.OI. 


Insert  Table  1  About  Here 


Geometric  Mathematical  Ability 

As  in  problem  solving  measure,  the  experimental  and  control  groups  were 
determined  to  be  at  similar  levels  of  geometric  mathematical  ability  at  the 
start  of  the  study  as  determined  by  an  analysis  of  their  pretest  means,  1 1.4  and 
1 1 .73  respectively.  An  analysis  of  these  data  using  an  independent  1  test  show 
no  significant  difference,  1(45)  =  .4024,  c<.01. 

The  experimental  and  control  group's  posttest  means  were  14.8  and  12.5 


respectively.  A  comparison  of  these  means  using  an  independent  i  test  showed 
a  moderately  significant  difference,  1(45)  °  178,  fi<.l. 

The  additional  analysis  of  the  exp'*rimental  group's  pretest  and  posttest 
means  using  the  dependent  1  test  show  a  significant  difference,  1(24)  -  3.21 , 
fi<.01 ,  whereas  the  control  group  showed  no  such  difference,  1(21 ) «  .92ft7, 

General  Discussion 

The  findings  of  this  study  tend  to  support  the  hypotheses  and  general 
educational  philosophy  of  LOGO'S  developer,  Seymour  Papert,  <n  two  importan* 
ways.  First,  the  group  of  children  who  used  LOGO  in  this  study  performed 
better  on  the  problem  solving  measures  than  the  group  of  children  who  received 
no  such  LOGO  programming  exposure.  This  is  consistent  with  Papert's 
conjecture  that  successful  programming  interactions  encourage  the 
development  and  exercise  of  problem  solving  strategies.  These  results  give 
evidence  that  these  strategies  might  be  able  to  transfer  beyond  the  contex:  of 
computer  experiences.  These  results  in  the  area  of  problem  solving  are  in  stark 
contrast  to  many  of  the  findings  reported  by  the  Bank  Sti  eet  College 
researchers  and  the  University  of  Israel  researcherj.  Second,  the  LOGO 
prQgrarnr..ng  group  appeared  to  gain  mathematical  insight  to  certain  geometric 
tasks  mt^rc'.y  by  their  LOGO  programming  experience,  whereas  the  non-LOGO 
group  did  not  change  significantly  during  the  three  months  in  which  the  study 
took  place.  These  geometry  aptitude  findings  presentee  here  appear  to 
contradict  the  findings  from  the  University  of  Edinburgh  v/ork.  Furthermore, 
these  results  vtere  obtained  In  a  very  young  group  of  children  and  were  the 
result  of  direct  computer  prog,  amming  interactions,  i.e.  no  supportive 
non-computer  instruction  was  provided. 

One  difference  between  previous  studies  an«^  the  one  presented  here 
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which  might  help  to  explain  the  Inconsistencies  concerns  the  learning 
environment  In  which  the  L060  programming  took  place.  This  study  presented 
LOGO  In  a  "guided  discovery"  environment  where  although  the  teacher  played  an 
important  role  In  the  learning  paths  taken  by  the  students,  there  was  still  an 
enormous  amount  of  freedom  for  the  students  to  experiment  with  the  LOGO 
microworlds.  This  possible  explanation  Is  supported  by  findings  of  another 
LOGO  study  In  which  a  guided  discovery  environment  was  also  encouraged.  The 
experimental  group  in  this  study,  conducted  at  the  California  Polytechnic 
Institute  of  California,  also  showed  significant  mathematical  gains  (Cron, 
1983).  Although  it  was  not  the  intention  of  this  research  to  examine  the 
attributes  of  successful  LOGO  learning  environments,  this  Insight  snould  be 
considered  by  current  teachers  in  the  planning  of  computer  education 
experiences  which  will  Involve  LOGO. 

Although  the  experimental  group  showed  a  significant  increase  in  their 
problem  solving  ability  as  measured  by  the  combinatorial  and  permutation 
activities,  one  question  which  must  be  asked  is  whether  or  not  this  difference 
is  important.  It  would  be  a  naive  conclusion  to  state  that  any  single  measure 
could  evaluate  something  as  complex  as  the  construct  of  problem  solving. 
Attempting  t.-^  evalute  problem  solving  or  systematic  thought  using  a  single 
measure  is  analogous  to  holding  a  highly  detailed  object  in  front  of  a  bright 
light  and  tnen  studying  its  shadow  on  the  wall;  the  ahadow  gives  the  observer 
'>nly  the  faintest  notion  of  the  object's  complexity.  Therefore,  since  these 
results  show  much  promise  for  LOGO'S  ability  to  present  a  problem  solving 
model  to  learners,  much  more  research  is  needed.  These  results  ihow  that 
leamprs  who  use  LOGO  appropriately  and  regularly  appear  to  gain  incidental 
problem  solving  aptitude,  that  is,  the  jroblem  solving  ability  gained  is  the 
result  of  the  programming  experience,  not  as  the  result  of  direct  teaching. 
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other  studies  have  shown  that  there  are  more  efficient  ways  than  LOGO  to 
increase  problem  solving  in  children  (Dalton,  1985).  Yet,  since  this  Increase  In 
problem  solving  ability  is  In  addition  to  other  assumed  benefits,  learning 
efficiency  does  not  play  as  important  a  role. 

Another  Important  issue  is  given  the  fact  that  LOGO  programming  does  in 
fact  increase  systematic  thought,  is  this  effect  desirable?  LOGO  appears  to  be 
an  obvious  answer  to  what  Plagetla.is  term  the  "American  question",  which 
asks  if  it  is  possible  to  Intentionally  hurry  children  through  their 
developmental  stages.  Papert  has  speculated  that  if  computers  and 
programming  eventually  become  part  of  the  cultural  fabric,  that  one 
consequence  might  be  that  children's  cognitive  development  might  be  hastened, 
especially  between  the  concrete  and  formal  operational  stages  (Papert,  1980). 
Regardless  of  the  answer  to  this  "question",  one  should  consider  David  Elkir^l's 
(!981 )  interpretation  of  childhood  where "...  it  is  Important  lo  see  childhood 
as  a  stage  of  life,  not  just  as  the  anteroom  of  life"  (p.  199).  Each  stage  should 
bt  given  equal  value  in  the  development  of  th^  being,  rather  than  merely 
interpreting  cognitive  development  as  a  "race"  to  be  won.  The  responsibility  of 
research  is  to  investigate  these  speculations  in  order  to  provide  objective 
ways  in  which  to  make  appropriate  decisions,  whether  instructional  or 
societal,  on  the  behalf  of  the  individual, 
{mplications  for  Future  Resparrh 

In  contrast  to  Papert's  criticisms  of  experimental  research  involving 
LOGO  28  a  treatment  variable,  several  recommendations  for  future  reseaixh  are 
to  be  made.  The  first  concerns  the  possible  treatment  interactions  involving 
the  learning  environment  in  which  LOGO  is  presented  to  children.  Considering 
the  results  presented  here  as  well  as  the  findings  from  the  Bank  Street  College 
of  Education,  the  University  of  Israel,  and  the  University  of  Edi.iburgh,  it  is 
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implied  that  LOGO'S  success  Is  heavily  dependent  upon  the  learning  context. 
This  learning  context  would  include  the  physical  elements  such  as  the  number 
of  computers  and  the  time  on  task,  but  most  importantly  the  basic  method  of 
interaction  such  as  free  discovery,  guided  discovery,  or  highly  structured. 
Future  research  should  center  on  the  effects  that  these  different  LOGO  learning 
contexts  have  on  the  child's  cognitive  growth.  Certainly,  future  research 
should  also  consider  the  individual  learner  characteristics  and  the  role  that 
these  difference^  play  in  determining  the  proper  LOGO  environments. 

It  has  been  pointed  out  that  there  presently  exists  a  unique  opportunity 
for  computer  education  research  (Lepper,  1985).  As  computers  begin  to  become 
a  part  of  our  daily  lives,  it  will  be  difficult  to  find  subjects  who  have  not  had 
prior  computer  experiences.  Without  such  subjects,  finding  an  appropriate 
control  population  will  not  be  possible.  This  fleeting  computer  "research 
window"  could  be  viewed  as  similar  to  the  history  of  research  in  educational 
television.  The  obvious  coriclusion  is  that  researchers  need  to  act  upon  this 
research  opportunity  before  it  disappears. 

This  study  has  raised  several  questions  concerning  the  learning  effects 
of  LOGO  on  young  learners.  It  is  hoped  that  further  research  will  contt.iue  to 
clarify  situations  where  using  LOGO  is  appropriate  as  well  as  inapropriate. 
Most  importantly,  more  research  appears  warranted  and  needed  in  this  realm  of 
computer  education. 
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Table  1.  Descriptive  Statistics  of  Treatment  Grnnpg 


Lwlmental  control 

Number  of  Subjects  25  22 

Problem  Solving 

PRETEST  MEAN  11.52  11.27 

(SD)  (5.9^)  (455) 

POSTTESTMEAN  17.6  10.59 

(SD)  (5.11)  (445) 

Geometry  Test 

PRETEST  MEAN  11.4  11.73 

(SD)  (2.57)  (3.01) 

POSTTESTMEAN  148  12.5 

(50)  (488)  (3.56) 
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SQUARE 


All  4  sides  are  equal. 
All  k  angles  are  equal. 
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The  k  little  squares 
make  1  big  square. 
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Both  squares  are  exactly  the 
same  size* 
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Side  A 


Side  A  is  exactly  twic 
as  long  as  Side  B. 


Side  B 
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All  3  squares  have  the  same  middle. 
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All  9  small  triangles  are  identical. 
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Name 


Age :  Yrs 


1.    Circle  the  90"  angle. 


2.    Circle  the  45°  angle. 


3.    Circle  the  10"  ar^le, 


4.    Circle  the  135  angle. 


\ 


V 


\ 


/ 


/ 


5.    Circle  the  270°  angle. 


I 


\ 


^.    Circle  the  350**  angle. 
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Finish  drawiiig  these  angles  so  that  thsy  match  perfectly  the  angle 


already  drawn. 


Finish  drawing  these  li^^es  so  that  they  are  exactly  the  same  length. 


Spin  Oscar  90    to  the  right . 


Spin  Oscar  180''  to  the  right. 
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Interactive  Cable  lelevlslon:    An  Evaluation  Study 


Rhonda  S.  Robinson  and  Peter  C  West 
Northern  Illinois  University 

Background 

Educators  are  taking  advantage  of  new  opportunities  to  expand  or 
improve  education  through  cable  television  and  microwave  technology. 
Telecommunications  can  extend  the  classroom  and  learning  potential  for 
hundreds  of  students.    Teleconferencing,  one  use  of  telecommunications, 
has  become  viable  for  education,  training,  and  business  meetings  both  In 
educa*^lon  and  business  and  Industry.    Teleconferencing  Is  a  dynamic, 
live,  Interactive  process  which  allows  students  in  different  locations 
to  conununlcate  and  participate  in  an  interactive  educational  experience 
(Olgren  and  Parker,  1983).    Interactive  television  is  one  form  of 
Instructional  television  which  has  proved  to  be  an  effective  and  popular 
medium  of  instruction,  more  so  than  the  ITV  programs  first  introduced  in 
the  1950's  (Bloom,  1984). 

There  are  many  critics  who  "believe  that  education  is  the  only 
major  American  industry  which  does  not  yet  make  intensive  use  of  modern 
technologies  to  reduce  its  costs  and  to  increase  the  scope  of  its 
services"  (Curtis  and  Bledenbach,  1979,  p.  3).     Several  interactive 
television  projects  around  the  country  have  begun  to  utilize  technology 
in  an  innovative  yet  practical  way  to  increase  the  overall  effectiveness 
and  availability  of  educational  opportunities  in  their  communities. 

A  project  begun  in  Illinois  in  August,  1983  is  an  attempt  to 
utilize  new  and  emerging  technologies  to  increase  the  effectiveness  of 
the  educational  process.    This  project,  the  Carroll  Instructional  Tele- 
vision Consortium,  was  the  first  cooperative  educational  program  of  its 
kind  in  IlJlnois,  and  was  born  of  the  common  need  of  four  small  rura] 
high  schools  to  offer  a  full  range  of  academic  opportunity  to  their 
students.    The  Consortium  utilizes  a  cable  television  network  already 
serving  the  four  districts.    Tlie  system  permits  simultaneous  video  and 
audio  communication  between  any  or  all  of  the  four  high  schools.  The 
two-way  television  consortium  represents  a  technologically  acceptable 
method  for  sharing  instructional  resources,  better  utilizing  faculty 
expertise  and  more  fully  serving  the  academic  needs  of  students. 

The  project  goals  of  the  Carroll  Instructional  Television 
Consortium  are: 

1.  To  Increase  the  total  number  of  course  offerings  available  to 
students  enrolled  in  the  participating  districts. 

2.  To  provide  fully  qualified,  experienced,  and  effective  faculty  to 
teach  advanced  level  course  work  in  mathematics,  science  and  foreign 
languages . 

3.  To  motivate  and  challei       talented  and  gifted  students  through 
association  with  comparable  students  from  other  districts. 
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4.     To  promote  high  levels  of  student  achievement  as  measured  by  content 
mastery  of  advanc^'^d  level  course  work. 


5.    To  increase  the  efficiency  of  teacher  instructional  time  in 

traditionally  low  enrollment  advanced  level  curricular  offerings. 

Based  initially  on  these  goals,  project  evaluation  was  designed  as 
a  five  year  process.    The  research  has  broadened  some  to  include  many 
factors  of  the  environment,  and  to  be  as  complete  as  possible. 

Project  evaluation  of  this  scope  has  many  inherent  problems.  The 
subjectivity  of  observation,  the  lack  of  control  of  population  or 
teaching  methods,  the  gaps  in  communication  or  cooperation  all  prevent 
the  researchers  from  utilizing  experimental  research  procedures  which 
could  add  morr  data  to  comparative  studies  literature^     Instead,  the 
design  of  this  research  was  based  on  naturalistic  research  premises;  the 
outcomes  will  be  non-statistical  but  rich  data  about  the  school  environ- 
ment and  the  project's  success.     This  study  employs  a  naturalistic 
paradigm  to  investigate  a  technologically  innovative  project  using  two- 
way  interactive  television  as  a  vehicle  to  enhance  curriculum. 

Although  this  is  a  fairly  recent  technology,  some  studies  have 
reported  on  utilization  of  interactive  television  instruction.  Inter- 
active television  has  been  successfully  integrated  xnto  education 
systems  and  is  a  cost-effective  means  of  augmenting  the  quality  of 
education  available  to  students,  especially  in  rural  areas.  This 
instructional  technology  increrses  the  spectrum  of  courses  available  in 
small  school  districts  and  offers  an  alternative  solution  to  consolida- 
tion of  the  school  districts  (Holt,  1985).    It  is  a  maans  to  developing 
an  educational  system  that  "substantially  expands  and  increases  high 
school  curriculum"  (School  Tech  News,  1985).    Microwave  and  cable 
transmission  of  two-way  video  provide  students  from  surrounding  school 
districts  with  the  opportunity  to  enroll  in  courses  which  otherwise 
would  have  been  available  to  only  f^Ae  school  due  to  a  shortage  of 
specialized  instructors.    Advanced  levels  of  foreign  languages,  science 
and  mathematics  are  high  school  courses  typically  offered.     Sharing  of 
subject  matter  experts  eliminates  the  need  for  students  to  be  trans- 
ported to  a  central  location,  or  for  the  instructor  to  travel  to  all  of 
the  sites  (Schramm,  1977).    Iiite  ractive  television  (ITV)  is  also  econom- 
ically feasible  because  the  expenses  incurred  are  shared  cooperatively 
by  the  school  districts  involved  in  the  program,  and  many  of  these 
expenses  are  non-recurring  (Pate,  1985).     It  is  most  economical  to 
connect  the  videoconferencing  system  with  an  existing  cable  television 
network  (Howe,  1984). 

Courses  taught  by  ITV  have  been  well  received  by  participants,  as 
evidenced  by    annually  increasing  enrollment  in  the  courses  and  an 
increase  in  the  number  of  course  offerings    o  accommodate  this  need 
(Jones,  1985).    Two-way  television  has  been  used  extensively  in  school 
districts  throughout  the  country,  and  with  a  high  degree  of  success 
(Jones,  1905).    Microwaves  for  Learning  in  Iowa,  Communicas ting  tor 
Educational  Purposes  in  Minnesota  and  the  Irvine  project  in  California, 
are  a  few  examples  cited  by  Jones.    No  significant  difference  in  test 
scores  resulted  when  a  College  L.  v^irnliig  course  was  taught  either  in- 
person  or  by  interactive  tv^o  way  television  (Johnson,  O'Connor  an 
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Rossing,  1984).    Survey  r-.oults  also  revealed  no  negative  attitudes 
regarding  the  instructional  strategy  utilized.    Graduate  students 
studying  supervision  via  Interactive  tw3-way  television  had  positive 
attitudes  about  the  mode  of  1  ist^uctlon  and  learned  equally  as  well  as 
the  control  group  (Johnson,  O'Connor,  Rossing,  1984). 

Though  the  technology  utilization  hns  been  studied  only  recently, 
these  studies  revealed  a  high  degree  of  Interest  In  both  the  effecthve-- 
ness  of  Interactive  systems  and  in  participants'  attitudes  towards 
learning  from  such  systems.    Project  reports  from  Trempealeau  County 
Wisconsin  and  from  Texas  A  &  M  (Johnaon,  O'Connor,  and  Rossing,  1983) 
show  preliminary  success.    The  Carroll  I.T.V.  Consortium  modeled  Itself 
In  part  after  the  Trempealeau  County  project.    Evaluation  reports  from 
Wisconsin  were  available  in  the  design  of  the  research  for  this  project. 

Objectives  of  the  Study 

This  paper  explains  the  research  being  conducted  to  evaluate  the 
project,  and  the  results  evident  from  data  collected  to  date.  This 
study  was  designed  to  determine: 

J.    Is  an  Interactive  television  system  effective? 

2.  Is  the  teaching/learning  process  affected  '/  use  of  interactive 
television? 

3.  Is  the  interactive  television  system  accepted  by  the  teachers,  the 
smdents,  and  administrators? 

4.  Are  the  project  goals  successfully  met? 


A  case  study  was  designed  to  intensively  study  the  status  and 
interaction  of  the  participants  and  this  project.    Data  is  b_J.iig 
collected  using  several  different  techniques: 

1.  Student  cognitive  growth  is  measured  by  pre-  and  post-tests  in  their 
subject  matter. 

2.  Students  are  surveyed  four  times  during  the  year  to  evaluate 
technical  aspects  of  the  system. 

3.  Teachers  are  observed  throughout  the  ye  r,  approximately  75  hours  in 


A.    Administrators  involved  in  the  innovation  are  interviewed  about 
their  decision-making  process  and  their  satisfaction  with  the 


The  case  study  metiiodology  includes  many  separate  data  cox^cjction 
techniques,  as  listed.  IJore  specifically,  evaluation  and  data  collec- 
tion includes: 


Method 


total. 


project. 
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1. 


A  comparison  of  1984-85  course  offerings  with  1983-84  course 
offerings  in  each  participating  district  by  the  district 
administrator  and  researcher. 


2.  Periodic  assessments  of  teacher  effectiveness  by  district 
administrators  and  the  researcher. 

3.  A  survey  of  student  opinions  about  teacher  effectiveness  conducted 
by  the  researcher  during  each  quarter  of  the  academic  year. 

4.  A  survey  of  student  attitudes  and  satisfaction  conducted  by  the 
resccircher  during  the  fourth  quarter  of  the  academic  year. 

5.  A  survey  of  teacher  opinions  about  student  motivation  and  degree  of 
challenge  conducted  by  the  researcher  during  the  fourth  quarter  of 
the  academic  year. 

6.  Teacher-made  tests  covering  learner  objectives  identified  in  course 
outlines  utilized  for  entry  and  exit  level  assessments  of  student 
mastery  of  course  content. 

7.  Analyses  of  student  achievement  scores  made  by  the  researchers  to 
assess:     1)  student  growth,  and    2)  comparison  of  achievement 
scores  for  students  located  at  originating  site  with  those  located 
at  remote  sites,  and  with  those  not  in  TV  classes  where  available. 

8.  A  comparison  made  by  district  administrators  of  enrollments  in  the 
televised  classes  with  enrollments  in  the  same  classes  taught  in 
individual  district  during  the  pi'^vious  two  years. 

Thus,  the  data  colleccion  has  been  triangulated  to  include  pre-  and 
post-tests,  student/teacher  surveys,  and  observation  and  interviews 
throughout  the  project.    Cuba  (1981)  suggests  that  triangulation  can 
improve  dependability  and  transferability  of  data  collected  in  natural- 
istic inquiry.    The  trustworthiness  of  observation  and  interview  data 
can  be  enhanced  by  the  coj.lection  of  survey  and  cognitive  growth  data, 
and  by  the  comparison  of  results  gathered  by  all  three  methodc.  Further 
explanation  of  each  data  source  is  available  (Robinson,  1985). 


This  study  has  been  designed  to  evaluate  and  assess  the  use  of 
interactive  cable  television  as  an  alternative  method  of  delivering 
courses.    Once  study  objectives  were  established  it  was  then  necessary 
to  attempt  to  determine  if  those  objectives  were  being  met.    The  results 
reported  here  are  based  on  the  second  year  of  this  five  year  project. 

The  first  objective  was  to  deteririne  if  a  two-way  interactive 
television  system  would  be  effective.     Previous  studies  have  been  done 
on  interactive  television^  but  many  of  those  studies  examined  systems 
that  were  one-way  video,  and  two-way  audio.    This  study  has  examined  an 
interactive  system  that  is  two-way  audio,  and  two-way  vide;. 


Results 
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In  order  to  accurately  assess  the  effectiveness  of  this  Interactive 
systems  pre-  and  post-tests  v/ere  administered.    The  pre-test  was  admin- 
istered to  assess  entry  level  skills  and  abilities  of  students.  The 
post-test  provided  data  which  indicated  how  well  students  ^earned  course 
material.    These  tests  were  given  to  students  in  all  classes  taught  over 
the  system.    Additionally,  if  a  class  being  taught  over  the  system  was 
also  being  taught  in  the  traditional  manner  in  one  or  more  of  the 
schools,  the  same  test  was  given  to  students  in  those  classes  as  well. 
Tho  courses  offered  over  the  .  were  math  IV,  shorthand,  Spanish  I 

and  II,  and  chemistry.    Prellmi         results  have  shown  that  among 
students  taking  courses  over  the     ,«item,  those  students  in  distant 
schools  are  scoring  as  well  as  students  in  home  schools  (where  the 
course  originates).     Since  many  of  the  clas.ses  are  small  (some  have  as 
few  as  4  students),  comparative  statistical  analysis  is  not  as  valid  at 
this  time  as  it  will  be  at  the  end  of  the  five  year  study. 

For  1984-1985,  a  comparison  of  mean  post-test  scores  has  been 
completed.    The  post-test  score  for  students  in  the  home  school  for 
Spanish  II  was  171.3  while  the  mean  post-test  score  for  students  in  that 
class  at  the  remote  school  was  193.33.    The  chemistry  class  produced 
similar  results:     the  mean  post-test  score  for  the  home  school  students 
was  33.5;  for  the  remote  school  students  it  was  36.43.    These  two 
classes  demonstrate  that  students  in  the  remote  classes  scored  a  bit 
better.     On  the  other  had,  home  school  students  in  the  Math  IV  class 
scored  somewhat  better  than  students  in  the  remote  schools.    Post  test 
mean  scores  for  students  in  the  home  school  were  91,  while  mean  post- 
test  scores  for  student  in  one  remote  school  were  75,  and  in  another 
remote  school  were  66.88. 

Just  as  significant  is  the  fact  that  students  enrolled  in  courses 
over  the  interactive  system  perform  almost  as  well  as  students  enrolled 
in  the  sam^;  class  taught  in  the  traditional  setting.    One  example  of 
this  is  the  Spanish  I  class.     Students  in  the  interactive  Spanish  I 
class  had  mean  post-test  scores  of  206,  while  students  in  the  tradi- 
tional Spanish  I  class  had  mean  post-test  scores  of  231. 

The  second  study  objective  was  to  determine  if  the  teaching/ 
learning  process  is  affected  by  the  use  of  interactive  television. 
While  it  is  true  the  term  "teaching/learning  process"  can  sometimes  be 
an  ambiguous  concept,  for  the  purposes  of  this  study  it  has  been  defined 
as  any  activity  associated  with  the  teaching  process  (i.e.  lecturiiig, 
class  discussion)  and  any  activity  associated  with  the  learning  proces > 
(i.e.  class  participation,  teacher  accessibility,  interaction  with 
classmates,  etc.).     Eased  on  the  responses  to  questions  on  a  survey 
administered  four  times  each  year  (see  Appendix)  students  reacted  posi- 
tively to  the  system.    Their  responses  Indicate  a  high  degree  of  satis- 
faction with  these  courses. 

The  students  do  not  feel  the  technology  Interfered  with  t'^^e 
teaching/learning  process.    93%  report  the  video  reception  as   ;ood  to 
excellent;  87%  indicate  they  can  hear  the  instructor  and  stuuents  in 
other  locations  without  any  problem;  75.9%  thought  the  ta^^back  feature 
did  not  interfere  with  their  ability  to  communicate  with  students  in 
other  locations;  78.7%  report  no  problems  with  having  d'^cess  to  the 
instructor  after  regular  class  hours;  89.8%  report  no  pre  lems  with 
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receiving  handouts,  tests  and  other  items  in  time  for  assignments;  and 
finally  85.6%  believe  material  in  the  interactive  class  is  es  easy  to 
follow  as  it  is  in  a  regular  class.    The  biggest  problem  with  the 
interactive  system  is  that  it  does  not  really  allow  studants  to  get  to 
know  their  classmates  from  the  other  schools.    75.4%  indicated  they  had 
little  opportunity  to  interact  with  students  from  other  schools. 

In  over  100  hours  of  observation,  it  was  noted  that  the  biggest 
obstacle  to  the  teaching/learning  process  was  "downtime."    Because  of 
factors  beyond  the  control  of  the  students  or  the  teachers  (i.e. 
weather,  technical  difficulties,  audio  interference)  there  were  times 
when  no  instruction  was  being  provided. 

The  third  study  objective  was  to  denermine  if  the  system  would  be 
accepted  by  the  students,  the  teachers,  and  administrators.  Again, 
information  was  collected  using  stude^       surveys,  interviews  with 
teachers  and  administrators,  and  observations  of  classes.    80.1%  of  the 
students  surveyed  gave  the  system  a  rating  of  average  to  excellent. 
Only  19.9%  reported  dissatisfaction  with  the  system.     Initial  interviews 
./ith  teachers  revealed  most  had  mixed  feelings.    The  .  achers  expressed 
fears  about  being  replaced  by  technology  (unfounded),  and  fears  about 
technology  in  general  (overcome  by  In-servi'ie  training).    The  majority 
of  teachers  interviewed  agreed  that  a  system  such  as  this  was  needed  to 
begin  offering  classes  that  would  not  otherwise  be  offered.  In 
addition,  they  saw  it  as  a  means  for  increasing  student  enrollment  in 
their  classes . 

The  fourth  study  objective  was  to  determine  iT  project  goals  are 
being  successfully  met.  As  stated  earlier,  the  goaxs  of  the  project  are 
to: 

1.  Increase  the  total  number  of  courses  offered. 

2.  Provide  qualified,  experienced  and  effective  faculty  to  teach 
advanced  level  courses  in  math,  science,  and  foreign  languages* 

3.  Motivate  and  challenge  talented  and  gifted  students. 

A.    Promote  high  levels  of  student  achievement  as  measured  by  content 
mastery  of  advanced  level  course  work. 

5.    Increase  the  efficiency  of  teacher  instructional  time  in  low 
enrollment  advanced  level  courses. 

Based  on  research  collected  to-date  through  observations  and  inter- 
views, all  of  the  above  goals  have  been  met,  and  in  some  cases 
surpassed.    Students  are  now  receiving  courses  they  would  not  otherwise 
have  had.    This  has  been  particularly  true  in  the  math,  science  and 
foreign  language  areas.    Because  the  system  allows  the  schools  co  offer 
these  advanced  level  courses,  talented  and  gifted  students  now  have  an 
opportunity  to  work  with  comparable  students  from  other  districts.  The 
only  project  goal  which  has  not  been  fully  met  is  to  increase  the 
efficiency  of  teacher  instructional  time.    Because  of  occasional  equip- 
ment start-up  problems,  and  inter-district  scheduling  conflicts,  teacher 
instructional  time  has  not  been  positively  effected. 
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Discussion 


Since  the  1940 's,  educators  have  looked  to  technology  to  revolu- 
tionize the  education  process.    However,  education  has  been  slow  to 
adopt  technology,  and  that  technology  has  not  brought  about  the  sweeping 
changes  once  anticipated.    Even  though  mllllors  of  dollars  have  been 
spent,  the  results  have  been  disappointing  (Prange,  1973). 

Interactive  television  Instruction  projects  such  as  the  Carroll 
Instructional  Television  Consortium  are  an  example  of  the  successful  use 
of  technology  for  education.    They  are  not,  however,  a  panacea.  There 
are  Inherent  problems  which  are  possibly  unsolvable,  bot  which  do  not 
negate  tne  positive  effects. 

For  example,  not  all  students  will  find  learning  via  technology  to 
be  conducive  to  their  learning  style.    Not  all  students  In  Interactive 
television  classrooms  feel  comfortable  learning  from  a  "distant" 
teacher,  nor  do  they  feel  that  they  get  an  opportunity  to  know 
classmates  In  other  rchools.    While  teachers  have  developed  techniques 
to  encourage  participation,  and  have  provided  opportunities  for  students 
to  get  better  acquainted  In  person,  these  are  only  partial  solutions. 
Interactive  television  systems  can  not  eliminate  the  problems  of 
geographic  distance . 

In  addition,  the  technology  luself  is  not  perfect.    Any  time 
technology  is  involved,  the  learning  process  can  be  interrupted.  There 
will  always  be  problems  with  atmospheric  and  external  Interference.  In 
this  project,  the  cable  system  can  be  rendered  inoperative  by  snow, 
interference  from  C.B.  radio  or  other  low  band  audio  broadcasts,  or  by 
cable  or  power  outages.    While  a  two  minute  breakdown  lu  audio  contact 
may  not  sound  like  a  technical  problem,  it  certainly  has  proven  to  be 
for  the  teachers  trying  to  encourage  participation  between  distant 
schools . 

The  strengths  of  this  study  are  its  longitudinal  design  and  its 
tri^ngulated  data  collection-     Instruments  utilized  are  similar  to  othe/ 
studies  on  interactive  television  projects  (Holt,  1985,  Johnson,  et.  al, 
1984).    To  date,  after  2  1/2  years  of  data  collection,  results  have 
tended  to  indicate  that  the  two  way  interactive  system  can  be  used 
successfully  in  the  educational  process.    Johnson,  et.  al.  (1984)  and 
Brad  Wincbell  of  the  East  Central  Minnesota  Educational  Cooperative  have 
found  similar  results  (School  Tech  News,  1985). 

The  data  from  this  study  has  also  revealec^  a  fairly  high  level  of 
satisfaction  with  the  system,  and  positive  student  attitudes.  These 
results  are  similar  to  those  reported  by  Johnson  and  by  Denton,  et.  al., 
(1985).     in  its  evaluation  of  the  project,  the  study  objectives  have 
been  similar  to  other  projects,  and  have  reported  similar  results. 
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While  interactive  cable  television  instruction  is  still  a  fairly 
new  technology,  the  research  is  beginning  to  indicate  that  systems  can 
oe  effective,  cost  efficient,  and  viable  alternatives  to  live  instruc- 
tion*    The  benefits,  problems,  and  drawbacks  need  continued  research 
before  a  definitive  statement  can  be  made  about  this  technological 
solution  to  an  educational  problem. 
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Appendix 


CARROLL  INSTRUCTIONAL  TELEVISION  CONSORTIUM 

Student  Survey 
1985  -  1986 

Your  School  ^  Did  you  take  a  TV  cour  - 

last  year? 

Instructor   

□  Yes 

Course   

□  No 

Ax**  ************** 

Please  rate  the  following  questions  on  a  scale  of  1  -  5  (1  =  poor, 

2  =  below  average,  3  =  average,  4  =  above  average,  5  =  excellent),  and  make 

any  additional  comments  you  care  tOr 

1.  What  was  your  opinion  of  the  TV  classes  before  this  class? 

I    I  no  opinion     Q  poor  idea  average  idea  above  average  idea 

2.  Why  did  you  have  that  opinion?  


3.  Is  the  reception  of  the  picture  good  enough  for  following 

the  lecture,  copying  materials,  and  taking  notes?    (1-5) 

4.  Can  you  hear  the  instructor,  and  the  students  in  the 

other  schools?    (1-5) 

5.  Do  you  feei  that  the  talkback  feature  allowed  you  to 
participate  as  effectively  in  this  class  as  in  regular 

classes?  (1-5) 

6.  Do  you  feel  as  comfortable  learning  from  the  TV  teacher 

as  you  do  from  a  teacher  in  a  regular  class?    (^~5) 

7.  Is  the  teacher  accessible  to  you  outside  of  regular  class 

time?    (1-5) 

Please  describe  when  and  how  the  teacher  is  accessible  to  you. 


8.    Do  you  feel  you  have  an  opportunity  to  get  to  know  your 
classmates  from  the  other  schools  as  well  as  you  get  to 

know  your  classmates  in  a  regular  class?    (1-5) 


11 

585 


9.    Have  you  been  receiving  band-outs  and  other  materials 

from  the  teacher  in  time  for  assignments?  (1-5) 


lO,  Do  you  feel  the  material  presented  in  this  class  has  been 

as  easy  to  follow  as  material  presentsd  in  regular  classes?  (1"5) 


!!•  How  well  do  you  like  the  TV  class?  (1-5) 


12.  In  general,  how  well  do  you  like  school?  (1-5) 


Are  there  any  additional  comments  you  woula  like  to  make? 
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WHAT  YOUR  PROFESSOR  NEVER  TOLD  YOU  ABOUT 
THE  MUNDANE  PRACTICE  OF  INSTRUCTIONAL  DESIGN 


Allison  Rossett 
Professor  of  Educational  Technology 
San  Diego  State  University 
San  Diego.  C^  92182-0311 


Introduction 

Graduate  education  provides  students  with  access  to  our  proud  and 
varied  theoretical  underpinnings.  There  is  communications  theory  ;  media 
research;  information  systems;  motivation  theo'y  and  behavioral  and 
cognitive  psychology.  At  the  university  we  enjoy  Merrill  and  Reigeluth, 
Gagne  and  Briggs;  Markle  and  Tiemann;  Fleming  and  Levie;  Cronbach  and 
Snow.  But  in  the  field,  when  a  training  professional  is  asked  what  references 
he  or  she  wants  to  take  to  the  moon,  it's  Robert  Mager  and....  the  bible.  No 
kidding,  that's  what  a  major  national  survey  found. 

This  presentation  briefly  reviews  some  hallowed  research  and  theory 
traditioni,  ones  I  too  have  shared  with  generations  of  students.  Then  we 
will  look  at  what  is  ictuaUy  happening  in  the  field.  My  experience  in 
corporations,  agencies  and  schools  and  a  recent  national  survey  suggests  that 
the  real  worid  praaice  of  instructional  design  bares  only  a  kissing  cousin 
resemblance  to  the  chapters  (£  Dick  and  Carey. 


Teitbook  Instructional  Design 

The  literature  offers  no  end  of  suggestions  for  the  systemrtic  anc! 
effective  development  of  instructional  products  and  services.  This  is  just  a 
brief  and  partially  attributed  listing: 

•  There  are  scores  of  models,  with  endless  arrays  of  boxes  and 
arrows. 
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•  Most  proponents  of  tbe  models  share  belief  in  needs  assessment: 
articulating  benaviorally  stated  objeaives;  using  objeciives  to  determine 
sirategies/m&dia  and  evaluation  criteria;  and  actually  carrying  ou'.  some 
for  m  of  assessment  to  determine  if  the  product  or  service  solved  the 
initiating  problem. 

•  Most  of  the  models  differ  in  allegiance  to  behaviorist  or  cognitivist 
perspectives,  with  some  writers  going  so  far  as  to  sound  a  death  knell  for 
instructional  development  if  we  refuse  to  throw  off  our  behaviorist  shackles. 
{Low.1981;  Sprague.  1981.  etc.) 

•  Presumably,  the  piirticular  theoretical  u..derpinnings  make  a 
significant  difference  in  the  practice  of  instructional  development. 

•  The  details  of  instructional  design  (for  example,  the  development  or 
clnssificaiicn  of  objectives  a  la  Mager  or  Gagne)  matter. 

•  Writers  and  researchers  in  instruaional  development  and 
educational  technology  herald  the  dawn  of  an  era  of  CBT  and  interaaive 
video/videodisc.  (Refer  to  issues  of  Educational  Technoioev  or  The  lournal 
of  Technological  Horizons  in  Education.) 

•  Our  literature  and  conferences  suggest  great  interest  in  authoring 
systems  and  languages  which  enable  subject  matter  experts  and  classroom 
teachers  to  design  CBT  without  being  programmers  themselves. 

»  Graduate  education  is  a  valuable  undertaking 


The  Practice  of  Instructional  Design 

I  have  taught  instructional  design  for  nearly  a  decade.  I've  taught  it 
to  graduate  students  at  the  University  and  to  course  developers  and  training 
specialists  in  settings  as  diverse  as  telephone  companies,  banks,  7-1 1 
training  centers,  and  the  United  Way.  I've  had  hundreds  of  discussions  with 
instructional  designers  and  their  managers  about  what  they  do  do,  what  they 
are  expected  to  do,  and  what  they  wish  they  knew  how  to  do. 
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TRAINING  magaziiie  s  October  1983  census  issue  adds  a  splendid  data 
base  to  my  experience.  This  past  summer  tbey  surveyed  thousands  of 
training  professionals.  I'm  convinced  that  this  survey  provides  us  with  2 
credible  picture  of  current  practice—  not  the  way  it  ought  to  be—  but 
certainly  the  way  it  currently  is  in  the  cubicles  icross  the  nition 
where  people  wLo  cell  themtelves  designers,  developers,  trainers, 
educition  specialists  and  educational  technologists  labor. 


•  There  is  little  talk  about  instructional  design  models  in  the  field. 
Most  training  departments  fight  fires,  responding  to  needs  and  issues 
initiated  by  others.  It  is  hard  to  find  the  time  to  cogitate  on  Florida  State's  or 
Michigan  State's  model  when  the  Director  of  Data  Processing  is  breathing 
down  your  neck  with  a  request  for  a  new  course. 

•  The  TRAINING  study  did.  however,  find  something  which  supports 
the  potency  of  systematic  approaches  to  training  and  development.  They 
asked  repondents  to  respond  affirmatively  or  negative^/  to  these  two 
questions:  "We're  too  small  to  justify  ISD;"  and  "Management  wouldn't  stand 
still  for  ISD."  If  respondents  said  yes  to  either,  they  were  much  more  likely 
to  report  that  training  was  less  important  m  their  organization  now  than  it 
was  two  years  ago.  If  they  said  no  to  both  or  either,  they  were  4  times  as 
likely  to  report  increased  budgetsl  Ron  Zemke's  commented.  Those  who 
practice  a  systematic  approach  fare  better  in  their  organizations." 

•  Have  you  ever  for  a  moment  doubted  the  omnipresence  of 
objectives  and  evaluation  in  the  real  world  of  instruaional  development? 
The  good  news  is  that  more  than  half  of  responding  professionals  in  the 
TRAINING  survey  say  they  do  indeed.... 

□  write  objectives  in  behavioral  terms 

□  assess  entry  level  skills  and  knowledge 

□  base  media  and  method  decisions  on  objectives 

□  test  programs  as  they  are  developed 

□  evaluate  the  effectiveness  of  programs 

□  use  feedback  and  test  performance  to  revise 
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But  the  bid  news  is  that  the  perceniages  responding  affirmaiively  are  so 
low. 

□  write  objeaives  in  behavioral  terms  (60r) 

□  assess  entry  level  skills  and  knowledge  (6-4%) 

□  base  media  and  method  decisions  on  objeaives  (78%) 

□  test  programs  as  they  are  developed  (65%) 

□  evaluate  the  effectiveness  of  programs  (63%) 

□  use  feedback  and  test  performance  to  revise  (87%) 

If  practitioners  write  objectives  only  60%  of  the  time,  how  often  do  you 
imagine  that  they  classify  them?  Or  use  those  classifications  to  make 
decisions?  Or  discuss  the  distinciiwis  between  Mager,  Merrill  and  Gagne- 
with  their  implications  for  instructional  design? 

•  Seventeen  percent  agreed  to  the  statement,  "Our  organization  is  too 
email  to  justify  the  processes  and  procedures  implied  by  the  above  items. " 
And  29%  said  yes  to,  "Our  management  would  never  stand  still  for  our  taking 
the  time  lo  follow  the  processes  and  procedures  implied  by  the  above  items." 

•  News  for  the  front  end  analysis  fans:  not  even  ^0%  report 
conducting  needs  assessments  and  task  analyses!  Forty-seven  percent  do 
discriminate  between  training  and  non-training  needs. 

•  Theory  is  of  mi  ch  more  interest  in  the  academy  than  it  is  to  the 
practitioner.  Only  in  Uie  largest  of  corporations  or  agencies  (e  g.  the  military 
or  AT&T)  is  there  support  for  discussior  of  the  theoretical  bases  for 
instructional  development  standards  and  guidelines. 

•  Cognitive  psychology  an    -     ation  theory  ars  making  small,  slow 
inroads  into  the  practice  of  instru.  w^«(l  design.  Large  corporations,  often  in 
the  telcommuD  ^tions  and  .I'ansportation  industries,  and  the  military 
services,  are  reworking  their  standards  and  guidelines  to  include  new 
perspeaives  and  accomodate  new  technologies. 

•  The  vast  m^ijority  of  computers  that  are  available  in  industry  and 
agencies  are  used  lOr  data  management  and  word  processing  not  CBT.  In 
1983  computers  ire  more  likely  to  be  used  for  instructional 
purposes  in  the  public  schools  thin  they  ire  in  corporite  America. 
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•  The  TRAINING  survey  found  that  we  are  siilJ  a  long  way  from  CBT 
in  every  corporaiion.  In  1 985.  27%  of  respondents  repori  using  CBT  or  CBI. 
When  CBT  is  used,  it  is  used  to  teach  about  computer  related  topics. 
Computers  are  only  rarely  a  means  to  provide  training  for  non-computer 
topics  like  leadership  or  basic  sales  skills. 

•  Instructional  interaaive  video  and  videodisc,  all  the  rage  at  San 
Diego  State,  is  just  beginning  to  have  an  impact  on  the  field.  Just  under  12* 
of  TRAINING'S  respondents  report  hooking  a  computer  up  to  video  or  a  disc 
player  for  traicing.  Interactive  videodisc,  the  most  promising  of  those 
delivery  systems,  is  being  used  in  fewer  than  3%  of  the  settings. 

•  Graduate  education  has  mixed  impaa.  Post  graduate  certificates 
and  master's  degrees  bore  no  statistically  significant  relationship  to  earning 
power.  The  doctorate  did.  adding  $4735  to  annual  earnings. 

•  Training  professionals  acknowledged  the  significance  of  graduate 
education  by  ranking  formal  education  second,  after  OJT,  as  a  contributor  to 
their  career  development. 


Conclusion 

While  we  may  lament  that  theory  and  practice  do  not  match, 
remember  that  it  has  been  a  very,  very  good  couple  of  years  for  our 
profession.  We Ve  enjoyed  an  optimistic  employment  pirture,  even  with  the 
downturn  in  the  computer  industry.  And  budgets  are  continuing  to  rise, 
albeit  slowly.  These  days,  everyone,  even  John  Naisbett,  Ronald  Reagan,  and 
my  mom,  is  interested  in  technology  and  training. 

So  what  can  we  learn  from  the  discrepancy  between  what  we  are 
talking  about  in  the  academy  and  what  happens  in  the  field? 

1.  That  our  models,  research  and  theories  are  not 
having  the  impact  on  the  field  that  we  desire. 
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2.  inai  academics  must  spend  some  time  speculating 
u'Jjy.  Is  it  for  lack  of  effort  on  our  parts?  A  mis  match 
between  our  iiteriiure  7.nd  the  reading  habits  of 
practitioners?  The  inability  of  our  graduates  to  make 
clear  cases  for  systematic  and  theory-based 
approaches?  An  absence  of  lean  and  sturdy 
prescriptions  for  practice  b^sed  on  this  research  and 
theory? 

3.  That  practitioner;:,  too.  must  self-evaluate.  Is  the 
current  state  of  praaice  sufficient?  Do  they  take  time 
to  evaluate  themselves  and  the  assumptions  under 
which  they  operate?  Are  practitioners  availing 
themselves  of  new  ideas,  theories  and  technologies? 
Are  their  skills  current?  Are  they  allowing  the  bottom 
line  to  rule  them  without  pressing  back  on  behalf  of 
more  optimal  instruaional  designs? 

For  tUe  past  decade,  academics  have  turned  to  the  field  for 
illumination  on  what  we  should  teach  our  graduate  students.  How  many 
studies  have  there  been  which  ask  employers  to  please  tell  us  what  they 
want  our  graduates  to  be  able  to  do?  Dozens,  maybe  hundreds.  While  that  is 
certainly  one  crucial  source  (£  inlormation,  it  is  not  the  only  source. 

The  field  is  ruled  by  concern  with  getting  the  job  done;  the  academy 
must  locus  on  how  it  might  be  done  belter.  There  is  obvious 
interdependence. 

What  I've  experienced  and  what  TRAINING  found  reminds  me  of  a 
responsibility  that  graduate  educators  may  overlook  in  our  haste  to  be 
relevant  to  the  needs  of  the  field:  We  must  do  more  than  respond  to 
the  field.  We  must  define  it  through  the  compelling  nature  of  the 
research  and  development  that  ve  do  and  model  it  through  the 
superlative  quality  cf  our  graduates. 

Nodding  in  agreement  isn't  good  enough.  I  am  asking  every  professor 
and  student  to  think  how  he  or  she  might  contribute  to  the  improved 
practice  of  instructional  design.  First  think  about  it.  And  then,  go  out  and 
doit. 
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Abstract 

This  study  inves  igated  the  effects  of  medium  of 
instruction,   task  difficulty,   and  gender  on  continuing 
motivation.     A  total  of  139  fifth  and  sixth  graders  with 
previous  computer  experience  completed  an  initial  learning 
task  in  one  of  the  two  media  formats  (computer  or 
paper/pencil)  and  under  either  a  hard  or  easy  difficulty 
level.     Subjects*  choice  of  instructional  medium  for  a 
second  learning  task  was  the  measure  of  continuing 
motivation.     Sixty-seven  of  the  69  computer  subjects  (97 
percent)  chose  to  return  to  the  computer,  whereas  only  one 
of   70  paper/pencil   subjects  (one  percent)  chose  to  return 
to  the  paper/pencil  form,    p<,0001.     The  remaining  69  chose 
the  computer  for  the  second  task.     Questionnaire  data 
indicated  that  computer  subjects  also  evaluated  their  own 
performance  significantly  more  highly,   reported  the  task 
to  be  significantly  more  interesting  and  easier,  and  had  a 
greater  desire  to  study  more  of  the  same  type  of  subject 
ma t  ter . 
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MICROCOMPUTERS  AND  CONTINUING  MOTIVATION 

Microcomputers  are  rapidly  becoming  an  important 
medium  of  instruction.     Research  on  computer-assisted 
instruction  (OAI)   has  often   focused  on  student  learning 
through  comparisons  of  several  teaching  methods  (Clark, 
1983;   Jamison,   Suppes,   &  Wells,   1974),  Some  evidence 
exists  that  CAI  may  be  more  effective  than  traditional 
teaching   methods   (Bell,    1983;   Kulik,    i983;   White,  1983). 
However,   Clark  (1983)  suggests  that  the  causal  comparisons 
between  CAI  and  achievement  are  confounded  by  the 
uncontrolled  effects  of  novelty  and   instructional  method. 
Indeed,   until  recently  relatively  little  attention  had 
been  given  to  how  strong  student  motivation  is  to  use 
computers  and  to  continue  to  use  them  under  various 
conditions.     Like  student  achievement,   willingness  to 
return  to  computer-based  learning  tasks  is  also  an 
important  consideration  related  to  the  effects  of 
compu  ter s . 

The  role  of  motivation  in  CAI  is  becoming  a  more 
prominent  topic  in   the  professional  literature,  .Swenson 
anci  Anderson  (198.^  state  that  the  motivational 
reinforcement  of  CAI  is  perhaps  its  strongest  asset.  The 
format  of  CAI  has  been  looked  at  for  clues  on  motivating 
characteristics  which  aid  learning  (Dence,    1980;  Malone, 
1980).     Roblyer   (1985)   noted   that   the  motivation  behind 
the  improvement  of  attitudes  toward  subject  matter  in  the 
CAI  format  is  often  attributed  to  the  computer  itself. 

Research  is  far  from  definitive  on   the  extent  to 
which  microcomputers  motivate  students  and  the  conditions 
that  maximize  the  motivation.     The  effectiveness  of  CAI 
has  been  attributed  in  part  to  a  novelty  factor  (Grimm, 
1978;   Kulik,   Bangert,   &  Williams,    1983).     However,  neither 
Kulik,   Kulik,   &  Cohen  (1980)  nor  White   (1983)  found 
evidence  for  a  novelty  effect  in  their  reviews  of  computer 
use.     Computer  experience  has  been  found   to  be  a  major 
factor  in  computer  attitudes  (Enochs,    198A;   Loyd  and 
Gressard,    198A).     The  motivational  effects  of  CAI  have 
also  been  examined  from  a  number  of  other  standpoints, 
including  retention,    feedback,    learner  control,  and 
individualization   (Dence,    1980;    Roblyer,  1985). 

A  considerable  body  of  recent  research  has  centered 
on  continuing  motivation  (McCombs,   198A),  which  generally 
has  been  defined  as  the  free  choice  to  return  to  a 
previous  learning  task  instead  of  an   alternative  task. 
The  difficulty  level  of   the  original  cask  and  the  gender 
of  the  learners  are  two  factors  that  have  been  found  to  be 
associated  with  continuing  motivation. 

Task  difficulty  is  well  established  as  a   factor  that 
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influences  motivation  (Lepper,    1985;    Story  &  Sullivan, 
1985),     Return  to  task,   as  the  measure  of  continuing 
motivation,   has  been  found  to  be  significantly  higher  when 
subjects  initially  perform  an  easy  task  rather  than  a  hard 
one  (Harter,   1975b;   Hughes,   Sullivan^   &  Mosley,  1985; 
Pittman,   Emery,   &  Boggiano,    1982).     Task  difficulty  has 
also  been  found  to  interact  with  subject  gender.  Boys 
tend  to  return  more  frequently  to  challenging  tasks  and 
girls   to  easier  ones  (Barter,    1975a, b;    Wigfield,  1984). 
Whether  the-s.-a  findings  on  continuing  motivation  as  it 
relates  to  task  difficulty  a   1  gender  extend  to  computer- 
assisted  learning  tasks  has     ot  been  investigated 
experinien tally . 

A  recent  study  by  Mosley,   Haas,   i  Story  (1984) 
suggests  that  tL:^  use  of  the  computer  itself  may  be  a 
strong  factor  in  promoting  continuina  motivation.  These 
researchers  studied  the  motivation  oi  sixth  grade  students 
for  ta.«:.ks  of  differing  difficulty  levels  as  presented 
exclusively  by  microcomputer.     The  overall  ret urn-to- task 
rate  on  the  computer-based  task  was  far  higher  than  return 
rates  in  two  previous  continuing  motivation  studies 
(Hughes,   Sullivan,   &  Mosley,    1985;   Mosley,    \983)  using 
learning  tasks  presented  only  in   paper/pencil  format. 

The  present  study  was  conducted  to  investigate 
experimentally  the  relationship  to  continuing  motivation 
of  instructional  medium,   task  difficulty,  and  sex  of 
subject.     Two  types  of  media,   computer  and  paper /penci 1 , 
were  crossed  with  two  levels  of  difficulty,  hard  and  easy. 
The  measure  of  continuing  motivation  was  scudent  choice  of 
instructional  medium  for  a  second  learning  task  after  they 
had  compleced  an  initial  task  either  on  a  microcomputer  or 
in  paper/pencil  form.     Student  attitudes  related  to  the 
uwo  media  v^ere  also  assessed. 

Method 

Sub jec  t s 

The  subjects  were   139  fif^\  and  sixth  grade  students 
from  six  classes  in  a  suburban  school  located  in  a  middle- 
class  socioeconomic  area.     All  were  familiar  with 
computers  and  the  school  com  put er  lab  where  the  research 
was  conducted. 

Materials 

The  experimental  materials  were  two  sections  from  the 
Grade  5-6  "Power  Switch"  unit  from  the  ( Energy  Source 
Programi    1984).     For  this  study,    two  separate  sets  of 
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eight  questions  each,  one  set*  to  be  answered  at  the  end  of 
each  of  two  sections,    were  adapted  from  questions  in  the 
original  unit.     The  questions  were  prepared  in 
paner/pencil  form  for  the  paper/pencil  group  and  were  put 
on  floppy  disks  for  the  computer  group.     The  format  of  the 
questions  was  the  same  a  computer  screen  as  on  paper. 

Feedback  was  included  a  every  item  on  the  coiaputer,  as 

is  noiraal  in  CAI,  and  atter  each  set  of  8  items  for  the 
paper/   pencil  group. 

The  easy/hard  variation  in  task  difficulty  was 
achieved  by  manipulating  the  difficulty  level  of  the 
questions.     The  questions  in  the  easy  version  were  three- 
choice  multiple  choice  items.     Those  in  the  hard  version 
were  completion  items  which  required  subjects  to  recall 
the  correct  answer  and  write  it  in.     The  multiple-choice 
and  completion  items  covered  identical  content.  A 
preliminary  tryout  with  one  Grade  5  class  and  uue  Grade  6 
class  indicated  that  the  two  versions  did  indeed  vary  in 
difficulty  level.     Students  averaged  43%  on  the  hard 
version  and   74%  on   the  easy  version. 

Procedures 

Boys  and  girls  were  randomly  assigned  to  one  of  the 
treatmeiit  groups,  computer  or  paper/pencil,  and  to  either 
the  hard  or  easy  difficulty  levels.     Except  for  their 
assigned  medium,   the  procedures  were  the  same  for  the 
computer  and   paper/pencil  groups. 

In  both  treatments,  the  text  was  read  aloud  by 
students  who  were  previously  identified  by  the  teacher  as 
good  readers.     The  other  students  followed  along.     At  the 
end  of  the  first  section,  subjects  answered  the  first  set 
of  questions  on  their  own  in  their  assigned  paper/pencil 
or  computer  medium.     Subjects  then  read  the  second  section 
and  answered  the  questions  over  it  in  the  same  manner. 
After  finishing  these  questions,  all  subjects  completed  a 
six-item  questionnaire  on  which  they  marked  their  choice 
of  medium  (computer  or  paper /pencil)  for  a  possible  second 
learning  task  and  indicated  their  perceptions  of  the 
initial  task. 

Data  Sources 

The  proportion  of  subjects  who  chose  to  return  to  the 
same  medium  for  the  second  tiask  served  as  :he  measure  of 
continuing  motivation.     Other  data  on  studen'  attitudes 
were  obtained  from  the  follow-up  questionnaire  items 
dealing  with  perceived  performance,  student  in^   rest,  task 
difficulty,   and  desire  for  further   study  about  energy. 
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Design  and  Data  Analysis 

The  experimental  design  was  2  (medium)  x  2 
(difficulty)  x  2  (gender)  completely  crossed  factorial 
design.     Data  were  analyzed  by  analysis  of  variance  for 
return  to  task  and  by  chi-square  for  the  questionnaire 
items • 

Results 

Return  to  Task 


The  frequency  of  subjects  returning  to  task  by 
treatment  and  gender  is  shown  in  Table  1.     The  2x2x2 
ANOVA  yielded  a  highly  significant  effect  for  medium, 


Insert  Table  1  about  here 


F(l,137)   =  1488.32,    p<.0001.     Sixty-seven   of   69  subjects 
(97  percent)  in  the  computer  treatment  chose  to  return  to 
the  computer  for  a  second  learning  task.     In  contrast, 
only  one  of  the   70  (one  percent)  in   the  paper/pencil 
version  chose  paper/pencil  for  tho  later  task.     The  other 
69  paper/pencil  subjects  preferred  the  computer  for  the 
second  task. 

The  effect  for  instructional  medium   was  so  powerful 
that  it  left  little  room  for  possible  effects  for  task 
difficulty  and  gender.     Nearly  all  subjects  at  both 
difficulty  levels  and  of  both  sexes  chose   the  computer  as 
the  medium  for  a  future   task.     Of  the  three  who  did  not, 
one  male  and  one  female  were  initially  in   the  hard 
difficulty  level  for  the  computer  group  and  one  female  was 
in  the  hard  level   of   the  paper/pencil  group. 

Student  Attitudes 

Attitudes  of  students  in  each  group,  as  indicated  by 
their  responses  on  the  follow-up  questionnaire,  are  shown 
in  Table  2.  As  shown  in  the  table,  significant 


Insert  Table  2  about  here 
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differences  favoring  the  computer  group  over  paper/pencil 
subjects  were  found  on  all  five  items.     Summing  of  the 
first  two  columns  for  items  1-3  reveals  that  more  students 
in  the  computer  group  thought  that  they  did  well  on  the 
activity  (85  percent  to  69  for  paper /pencil),    that  the 
activity   was  interesting  (96  percent  to  81),   and  that  the 
activity  was  easy  (80  percent  to  47).     More  computer  than 
paper/pencil  subjects  also  reported  that  they  would  rather 
study  energy  again  than  another  subject'  (29  percent   to  14) 
and  that  they  would  rather  do  another  energy  lesson  than 
not  do  another  lesson  at  all  (87   percent   to  64  percent). 

En  Route  Performance 

Mean  scores  for  performance  on  the  16  e_n  route 
practice  items  were  also  calculated  for  the  two  treatment 
groups.     The  overall  means  were  very  similar  for  the  two 
groups--7.72  items  correct  for  paper/pencil  and  7.64 
correct  for  computer  subjects. 

Total  time  on  ta;^k  was  approximately  45  minutes  for 
both  the  computer  aad  paper/pencil  subjects  and  did  not 
differ  signif ican tl>   between  the  two  groups. 


The  present  study  was  conducted  to  investigate  the 
effects  of  medium  of  instructional  practice  and  task 
difficulty  on   the  continuing  motivation  of  boys  and  girls. 
Results  indicated  an  extremely  strong  preference  for 
further  instructional  practice  on  the  microcomputer  over  a 
paper/pencil  format.     This  effect  was  so  strong  that  it 
left  room  for  only  slight  variations  related  to  task 
difficulty  and  subject  gender.     Questionnaire  responses  of 
subjects  also  revealed  much  more  favorable  attitudes 
toward  the  computer  than  paper/pencil. 

The  most  profound  finding  was  the  strong  motivational 
effect  of  the  computer  as  indicated  by  the  fact  that  67  of 

69  students  (97  percent)  in  the  computer  group  and  69  of 

70  (99   percent)  in   the  paper/ pencil  group  chose  the 
computer  for  their  second  learning  task.  Though 
microcomputers  have  been  cited  as  having  high  motivational 
value  (Lepper,   1985;   White,   1983) ,   the  overwhelming 
preference  demonstrated  by  subjects  in  this  study  was 
certainly  unexpected.     Preference  for  the  computer  was 
nearly  unanimous  whether  students  did  the  initial  task  on 
the  computer  or  in  paper/pencil  for.nat.     This  powerful 
preference  occurred  even  though  students  in  the  computer 
group  did  not  perform  any  better  on  the  en  route  practice 
items  for  the  learning  task  than  did  those  in  the 
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paper/ pencil  group. 

Another  strong  finding  was  the  important  positive 
effect  the  computer  had  on  student  attitudes.     The  more 
positive  attitudes  revealed  by  the  questionnaire  responses 
complemei^t  the  return-to-task  data.     Certainly  interest  is 
an  important  component  of  motivation  (Hawkins,  1984; 
Maehr,    19/6;   Malo-^e,   1980).     Subjects  in  the  computer 
group  rated  the  learning  as  more  interesting  than  those  in 
the  paper/pencil  treatment,  even  though  the  substance  of 
the  activity  was  the  same  for  both  groups.  Similarly, 
more  subjects  in  the  computer  group  thought  that  they  did 
well  on  the  activity  and  that  it  was  easy.     Yet,  these 
impressions  were  not  substantiated  by  the  performance  data 
for  the  task — the  two  groups  performed  almost  equally  well 
on  the  practice  items,   with  a  very  slight,  nonsignificant 
difference  favoring  paper/pencil  subjects.     That  is,  ^ince 
the  computer  group  did  not  in  fact  outperform  the 
paper/pencil  group,    merely  doing  the  task  on  the  computer 
apparently  resulted  in  their  thinking  that   they  did  well 
and   that   it  was  easier. 

The  positive  attil'"^ps  associated  with  the  computer 
as  a  medium  of  instruction  also  generalized  to  the  subject 
matter  itself.     A  significantly  greater  number  of  subjects 
in  the  computer  group  than  in  the  paper/pencil  group 
reported  a  preference  for  studying  energy  again  over 
studying  some  other  subject  matter  and  over  not  doing 
another  activity  at  all.     That  use  of  the  computer  to 
study  particular  subject  matter  could  increase  students* 
interest  in  that  subject-matter  area  is  potentially  an 
important  finding.     It  would  be  especially  valuable  if 
students  could  maintain  the  increased  subject-matter 
interest  on  a  long-term  basis  and  if  they  were  motivated 
toward  more  independent  study  of  the  subject-matter  area. 

The  strength  of   the  motivational  and  attitudinal 
effects  associated  with  the  computer  were  surprising  in 
that  it  was  intentionally  used  only  as  a  substitute  for 
the  paper/pencil  medium.     To  keep  other  conditions  highly 
similar  across  the  two  presentation  media,   no  other 
capabilities  such  as  special  graphics  or  personalized  or 
interactive  feedback  were  incorporated  into  the  computer 
treatment.     The  re'^ults  produced  Dy  the  corr  jufer  under 
these  constraints  suggest   that  instructional  applications 
that  capitalize  on  its  special  capabilities  (Sawyer,  1985) 
may  further  complement  its  motivational  potential. 

Although  this  study  was  designed  to  deal  with  student 
motivation,   it  also  yielded  data  on  ejn  route  performance 
on  the  learning  task.     li\  contrast  with   thr  motivational 
and  attitudinal  data,   the   performance  scores  of  the 
computer  and  paper/pencil  groups  were  virtually  identical. 
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Thus,    there  was  no  evidence  that  the  more  positive 
attitudes  of  the  computer  group  or  their  item-by-item 
feedback  had  an  effect  on  their  achievement  on  the 
learning   task.     This   finding  is  consistent  with  Clark's 
(1983)  contention  that  different  presentation  media   per  se 
do  not  directly  affect  student  learning  when  the  other 
elements  of  the  instruction  are  th3  same  across  the  two  or 
more  media. 

The  medium  of  instruction  was  so  much  more  powerful  a 
variable  than  either  subject  gender  or  task  difficulty 
that  no  meaningful  conclusions  can  be  drawn  from  this 
study  about  the  relationship  of  the  latter  two  variables 
to  continuing  motivation.     The  overwhelming  preference  for 
the  computer  washed  out  any  differences  that  might  have 
occurred  for  gender  or  task  difficulty  under  other 
conditions.     This  preference  was  nearly  unanimous  among 
both  females  and  males  and  across  both  the  hard  and  easy 
difficulty  levels. 

The  present  findings  clearly  reveal  that 
microcomputers  potentially  have  strong  positive 
motivational  and  attitudinal  effects  in  the  classroom. 
Still,   considerable  caution  should  be  exercised  in 
generalizing  too  freely  from  these  r;sults  to  long-term 
classroom  practice  because  this  study  measured  only 
immediate  effects  from  a  one-session  experiment.  The 
novelty  effect  often  associated  with  computers  might  have 
been  a  factor  in  the  present  results,   but  any  such  effect 
may  have  been  reduced  by  the  fact  that  the  subjects  were 
experienced  with  computers.     Overall,   the  positive  results 
favoring  the  computer  group  were  so  strong  and  consistent 
that  it  seems  highly  probable  that  they  were  due  primarily 
to  the  appeal  of   the  computer  itself  and  only  secondarily, 
if   at   all,    to  other  factors. 

A  worthwhile  area  for  further  research  is  the  study 
of  effects  of  microcomputers  when  they  are  used  as  the 
primary  medium  of  instruction  with  a  program  over  an 
extended  time  period.     Would  students  continue  to  show  the 
strong  preference  for  the  computer  that  they  demonstrated 
in  this  study,  or  would  it  lose  much  of  its  appeal  over 
time?     Student  interest  in  the  subject  matter  itself  and 
student  achievement  would  also  be  important  factors  to 
investigate  in  such  longer-range  studies.     Research  on  the 
effects  of  microcomputers  over  an  extended  period  should 
help  us  better  understand  their  most  productive  uses  in 
promoting  student  motivation  and  achievement  in  the 
classroom. 
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Table  1 

Frequency  of  Return  by  Medium  of  Instruction.  Gender, 


and  Task  Difficulty! 


Computer  Practice 
Female        Male:  Total 


Paper/Pencil  Practice 
Female        Male  Total 


Hard 


17/18 
(94%) 


18/19 
(95%) 


35/37 
(95%) 


1/19 
(5%) 


0/15 
(0%) 


1/34 
(3%) 


Easy 


18/18        14/14        32/32  0/15  0/21  0/36 

(100%)       (100%)       (100%)  (0%)  (0%)  (0%) 


Total 


35/36 
(97%) 


32/33 
(97%) 


67/69 
(97%) 


1/34 
(3%) 


0/36 
(0%) 


1/70 
(1%) 


The  cell  entries  represent  the  number  of  students  out 
of  the  tota.l  cell  number  who  chose  to  return  to  the  same 
medium  for  the  second  task.    For  example,  17  of  the  18 
female  students  (94%)  on  the  computer  version  of  the  hard 
task  chose  the  computer  for  the  second  task.    In  contrast, 
only  one  of  19  female  students  (5%)  in  the  paper/pencil 
version  chose  to  return  to  it.    The  other  18  chose  the  com- 
puter version  for  the  second  task. 
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Table  2 

Questionnaire  Responses  by  Treatment 

Questionnaire  Items  and  Responses  ^  &  p  level 

What  do  ^qu  think? 

1.  On  this  activity,  I  think  I  did: 

very  ^  very  a, 

well  well  badly         badly  =  10.751 

Computer  36%  49%  12%  3%  p  <.02 

Paper/Pencil  17%  52%  17%  14% 

2.  I  thought  this  activity  was: 

very  very  ^ 

interesting  interesting  boring  boring  7C  (3)  »  10.417 

Computer                      57%                  39%  3%  1%  p  <.02 

Paper/Pencil                34%                 47%  13%  6% 

3.  I  thought  this  activity  was: 


vei y  very  ^ 

easy  easy  hard  hard  (3)  =  17.888 

Computer  Tl%  61%  17%  3%  p  <.0005 

Paper/Pencil  17%  30%  40%  13% 


If  we  return  to  do  more  activities  with  you,  what  would  you  prefer? 

4.  (a)  study  energy  again:  (b)  study  some  other  subject; 

Computer  =  29%  Computer  =  71%  X*(l)  =  4.259 

Paper/Pencil  =  14%  Paper/Pencil  »  86%  p  <.05 

5.  (a)  do  another  energy  lesson:  (b)  not  do  another  lesson  at  all: 

Computer  =  87%  Computer  »  13%  X^l)   -  9.991 

Paper /Peacil  =  64%  Paper /Pencil  =  36%  p  <.002 
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THE  EFFECTS  OF  ORGANIZATIONAL  CUE3  ON  LEARNERS'  PROCESSING  OF 

INSTRUCTIONAL  PROSE 

Researchers  and  developers     have  given  considerable 
attention  recently  to  the  design  and  development  of  instructional 
text    fJonassen,    1983,   1985;   Waller  ?<  Duffy,   1985).  Guidelines 
arxs^.ng  from  this  emphasis  recommend  techniques  with  which 
authors  of   instructional   messages,  whether  they  be  mediated  in 
printed  text,   CRT  display,  or  other  electronic  media,  may  employ 
X  n  order  to  desx  gn  ef f ect  x  ve ,   unambx  guous  tex  t .     A  very  common 
recommendatx on  is  that  designers  of   instructional   text  make  the 
structure  or  organxzatxon  of   an  xnstructional   passage  as  explxcxt 
as  pos3xble  through  the  use  of  outlxnes,   headings,  summaries, 
txtles,   marginal   notes,   and  transitions  that  cue  top-level 
structure   (e.g.,   Hartxey       Burnhill,   1980;    Irwin  S<  Davis,  1980). 
Provision  of  such  cues  in  text  is  hypothesized  to  promote 
top-down  processing,   i .e. ,  the  formation  or  activation  of 
relevant  schemata  in  order  to  ease  the  decoding  burden  of 
readi  ng. 

Although  the  use  of  such  cuing  techniques  has  proved  to 
enhance  retention  and  coaiprehensi on  in  many  cases,   this  effect 
has  not  been  unilateral    (Brooks,   1981;   Chrxstensen  S<  Stordahl  , 
1955;   Hartley,  Kenely,   Owen,   it  Trueman,    1980;   Klare,  Shuford,  JS< 
Nxchols,   1958).     These  equivocal  effects  may  be  the  result  of 
learners'  differential  susceptibility  to  organizational  cues  in 


text.  Some  learners  may  simply  be  unaware  of  the  role  of  these 
cues  in   hhe  xnstructional   message  and/or  how  to  utilize  these 
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cues  in  order  to  enhance  comprehension  and  aid  recall. 


If  this 


IS  the  case  ,  i  nstructi onal   designers  may  f ai  thf ul 1 y  i ncorporate 
e;(plicit  organizational   cues  in  their  materials,   and  stxll  find 
that  substantial   portions  of  their  target  audience  do  n-it  benefit 
from  such  textual   aids.     The  studies  reported  in  this 
presentation  investigated  the  differential  effects  of 
organizational   cuing  and  strategy  training  on  a  group  which  has 
been  suggested  as  particularly  inserisitiv©  to  the  effects  of 
organizational   cues:   learning  disabled  adolescents  (Stanovich, 
19835   Woodward  S<  Peters,  1983). 

One  Gjjplanation  offered  for  LD  students'   learning  problems 
is  that  they  possess  the  innate  capacity  to  succeed  on  such 
tast 5,   but   lack  knowledge  about  and/or  the  ability  to  use 
stratf?gie5  which  promote  efficient   learning.     Torgesen  (1977, 
1979)    1 n vest 1  gated  this  hypothesi  s  in  his  semi  nal   study  of  LD 
students'   ability  to  memorize.     He  found  that  LD  students 
performed  as  well   as  their  iionLD  counterparts  in  a  memorization 
task  when  first  taught  a  strategy  for  learning  stimulus  word 
lists.     Torgesen   (1980)   argued  convincingly  that  LD  student  had 
the  ability  to  learn,  they  simply  did  not  know  how  to  approach 
the  learning  task, 

The  concept  of  strategy  training  has  been  widely  recommended 
as  a  means  of  designing  effective  instruction  for  secondary  LD 
srtudents   (Alley  &  Deshler,    1979)5   Smith,   19835   Woodward  &  Peters, 
1983).     Alley,   Deshier,   and  their  colleagues  have  made 
significant  contributions  in  strategy  deficit  remediationi  They 
have  outlined  a  series  of  steps  for  teaching  learning  strategies 
to  LD  adolescents   (Deshler,  Alley,  Warner,  &  Schumaker,   1981)  and 
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have  completed  numerous  studies  demonstrating  the  efficacy  of 
this  approach.     A  modification  of  this  approach  was  employed  in 
Study  2. 

This  presentation  will   describe  the  findings  of   twc  studies 
that  investigated  the  following  questions  related  to  this 
specific  audience's  response  to  organizational  cues  in  texts: 

Study  1 

Does  organizational  structure  have  differential  effects  on  LD 
and  nonhandi capped  learners'^  Do  these  effects  vary  according  to 
the  type  of  organizational  structure? 

Study  2 

—  Can  a  reading  strategy  employing  recognition  and  utilization 
of  organizational   structure  be  taught  to  LD  students?     How  does 
this  training  influence  their  recall   and  retention  of 
i  n struct  ion al  prose? 

Study  1 

Participants  and  Methodology 

The  participants  for  this  study  were  37  LD  and  50 
nonhandi capped  students  from  a  suburban  high  school    (grades  10 
through   12)   in  central  Oklahoma.     Students  from  each  group  were 
randomly  assigned  to  treatment  conditions  such  that  half  of  each 
group  read  a  passage  with  a  comparison-contrast  top-level 
structure  and  half  re»d  a  passage  with  a  description  top'-level 
structure- 
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The  instructional  passages   (7-8th  grade  reading  grade  level, 
Dale--Chali   readability  -formula)   used  in  this  study  were  content 
area  reading  passages  -From  high  school   social   studies  texts. 
Passages  with  two  dif-ferent  top-level   structures  were  used  in 
order  to  ascertain  if  LD  and  nonhandi capped  students  were 
di -f -f  erenti  al  1  y  sensitive  to  a  very  cohesive  structure 
(comparison/contrast  structure)   and  a  less  cohesive  structure 
<  descr i  pti  on  structure) . 

Data  were  collected  in  three  sessions.     First,   students  were 
supervised  by  their  teachers  while  answering  the  ten  pretest 
comprehension   questions  designed  to  determine  prior   knowledge  o-f 
content.     One  week   later,   they  read  their  assigned  passage, 
CwtTipl&ted  the  immedic^te  recall    t*^s^  ,   and  then  responded  to  the 
set  o-f   15  posttest   compr  j^hensi  on  questions.     One  week  after  the 
above  procedure,  the  teachers  administered  the  delayed  recall 
task. 

Comprehension  items  were  scored  as  right  or  wrong.  Recall 
protocols  were  scored  in  two  ways.     First,   they  were  scored  for 
idea  units  recalled  using  a  procedure  suggested  by  Meyer's  <1975> 
discourse  analysis  technique.     Interrater  reliability  of  the 
scoring  was  found  to  be  .97.     Participants'   sensitwity  to 
organizational   structure  and  author's  cuing  of  such  structure  was 
assessed  by  their  use  of  the  author's  organizational  structure 
when  produci  ng  thei  r  wri  tten  recal 1  protocol s.     A  rati  ng  seal e 
adapted  from  Swanson   (1980)   was  used  to  assess  use  of  text 
structure  in  recall.     An  interrater  reli^oility  of   .83  was 
obtained  using  this  instrument. 
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Results 


Two  2   (passage:   comparison/contrast,  description)   X  2 
(qroup;    LD  and  nonLD)   analyses  of  covariance  with  prior  knowledge 
as  a  covarxate  revealed  the  LD  students  were  indeed  less 
sensitive  to  the  author's  top-level  structure,  regardless  of  the 
passage  type,  both  at  the  immediate  stage   (F| ,si  s  4.19,  p 
<   .044)   and  at  the  delayed  recall   stage   <Ffv(|  =  5.85,  p  < 
.018).     This  lack  of  sensitively  to  structure  influenced 
participants'   level,  of  recall.     Two  one-way  ANCOVAs  examined 
three  levels  of  text  structure  use  (high,  medium,  and  low)  on 
immediate  and  delayed  recall.     Text  structure  use  had  a 
significant  effect  on  immediate  recall    (F  ,     =  6.84,  p  < 
.002)   and  delayed  recall    (F,     =11.51,   p^  .0001). 
Tables  1-6  show  the  means  of  thF^se  treatment  groups  by  the 
types  of  learners. 


Participants  and  Methodology 

Participants  were  73  learning  di  sab led  adolescents  (grades 
10  through  12)   in  two  high  schools  in  Oklahoma.     The  schools  were 
randomly  assigned  to  one  of  the  two  treatment  groups.  An 
examination  of  reading  test  scores  from  the  two  groups  indicated 
that  groups  were  equi  tabl e  i  n  general   readi  ng  abi 1 i  ty .     One  group 
received  instruction  in  a  reading  strategy  emphasizing  the 


Insert  Tables  1  - 
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recognition  and  use  of  authors'  organisational   structure  while 
encodi  ng  and  retr  i  evi  ng  i  nstructi  onal   prose.     The  st?cond  group 
received  a  placebo  instruction  on  generic  problem  solving  (not 
related  to  prose  processing),  The  Productive  Thinking  Program 
(Covington,   M.V.  ,  Crutch-field,  R.F.  ,  Davies,,  L- ,  &  Olton,  R.M., 
1974) . 

During  the  week  prior  to  instruction,  each  group  was 
pretested  in  order  to  assess  their  recognition  of  common 
organizational   structures,  their  recall  of  instructional  prose, 
and  their  ability  to  organize  their  recalls  using  the  author's 
orqani  ;!at  lonal   structure.     The  following  week,   each  group 
received  approximately  four  hoi       of  instruction.  The 
ejperimental   group  completed  print-  and  teacher -medx ated 
instruction,   including  instruction  on  recognizing  five 
organizational   structures  commonly  used  in  content  texts 
( t  ime-order ,  p rob 1  em-sol uti  on ,   cause-effect ,  compari  son-contrast , 
description)   and  using  these  structures  as  aids  during  encoding 
and  retrieval.     This  instruction  was  typified  by  extensive 
practice  with  examples  and  nonexamplee,  teacher  and  peer  modeling 
of  strategies,  and  analogical   illustrations  to  describe  mental 
processes.     The  i  r^struct  i  onal   strategy  for  this  trai  ni  ng  f  ol  1  owed 
these  phases: 

a)  students  were  asked  to  read  and  recall   a  lengthy  passage 
with  an  ejcplicitly  cued  text  structure; 

b)  they  were  asked  to  describe  th«3  manner  in  which  they  went 
about  reading  and  remembering  the  material  and  the 
inefficiency/inadequacy  of  this  approach  was  discussed; 

c)  a  iipw  strategy  using  text  structure  as  an  encoding  and 
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retrieval   cue  was  presented  as  a  more  e-f-f icient/ef -fecti ve 
approach  to  this  type  of  reading; 

d)  students  were  taught  to  recognize  -five  typical  expository 
structures; 

e)  they  practiced  this  identification  with  increasingly 
complex  prose; 

f)  the  text  processing  strategy  was  presented,  modeled  by 
the  instructor  in  a  think-aloud  manner,   and  then  practiced  in 
peer  dyads  with   increasingly  complex  material;  and 

g)  students  practiced  identifying  instances  when  th3 
strategy  could  be  appropriately  applied. 

The  control   group  completed  workbook  exercises  on  general 
problt^m  solving  strategies  such  as  locating  and  describing  the 
problem,   considering  alternative  solutions,   etc.     At  the 
conclusion  of  the  week,   students  completed  a  posttest  that 
assessed  their  recognition  of  common  organizational  structures, 
their  use  of   structure  in  organizing  recall   of  an  instructional 
passage,  and  their  recall   of  the  passage  content.     One  week  after 
the  final   instructional  session,  all  students  responded  to  a 
delayed  posttest  which  was  an  alternate  form  of  the  posttest. 


Four  separate  2   (reading  level:   low,   reading  level   =  4.0  - 
7.0;   high,  residing  level   =  7.  1       10.0)   X  2  (treatment: 
experimental,  control)   analyses  of  variance  were  conducted  in 
order  to  examine  the  main  effects  and  interactions  of  the 
tre" _ments  and  reading  levels  on  four  dependent  variables 
(immediate  recognition  of  structure  type,   immediate  recall 


Results 
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performance,  delayed  recognition  of  structure  type,   and  delayed 
recall   performance).     An  alpha  level   of   .05  was  set  prior  to 
conducting  the  analyses. 

The  ANOVAs  revealed  several  main  efftjcts,   including  main 
effects  for  treatment  on  immediate  recognition  of  structure  typo 
^^I^SO^  141.954,  p  <   .001),   on  immediate  recall 
performance   <F|,9o-  26.039,  p  <   .001),   on  delayed 
recognition  of  structure  type   <F|,5^=  99.562,  p  <  .001), 
and  on  delayed  recall  performance   <F|  ,50  =  20.   737,  p  < 
•001).     No  interactions  were  found  between  treatments  and  reading 
groups.     Tables  7-8  show  the  means  in  the  analyses. 


Learners'  written  recall  protocols  showed  evidence  that 
students  in  the  experimental  group  used  the  t&xt  structure 
strategies  they  had  been  taught:     several  drew  pictures  of  the 

structures,  other  underlined  key  words,  and  many  organized  their 
recalls  according  the  text  top-level  structure. 

Conclusions 

The  results  of  Study  1   indicate  that,  as  anticipated,  LD 
students  are  not  as  sensitive  as  their  nonhandicapped 
counterparts  to  the  organization  of   instructional  prose.  This 
i nsensi ti vi ty  appears  even  when  prior  knowledge  is  statistically 
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partialed  out.     In  addition,  results  suggest  that  this  lack  of 
sensitivity  contributes  to  LD  students'   poorer  recall  and 
retention  of  instructional  prose. 

The  results  of  Study  2  indicate  that  training  in  a  text 
structure  use  strategy  did  significantly  improve  both  students' 
recognition  of  these  structures  and  their  recall   of  instructional 
content,  and  this  effect  remained  relatively  stable  over  at  least 
a  week.      In  other  words,   the  results  strongly  suggest  that 
students  who  typically  experience  severe  difficulty  in  reading 
comprehension  can  be  taught  to  use  a  text  structure  strategy,  and 
this  instruction  can  improve  their  recall   of   information  within 
social   ^studies  passages.     An  examination  of  the  students'  recall 
protocols  indicated  that  students  in  the  experimental  group 
actually  used  the  strategy  during  the  reading  and  recall  tasks. 
In  addition,   xn  the  weeks  following  the  study,  the  LD  students' 
teachers  reported  that  the  students  continued  to  make  reference 
to  and  use  their  newly  acquired  reading  strategy.     Evidently  the 
strategy  training  had  considerable  impact  upon  students'  encoding 
and  retrieval  behaviors. 


The  conclusions  of  these  studies  have  several  implications 
for  designers  and  developers  of  instructional   print  materials. 
First,  they  provide  evaluative  data  on  a  particular  instructional 
strategy  for  teaching  toward  cognitive  strategy  outcomes. 
Second,  they  point  out  that  including  explicit  cues  to 
organizational  structure  in  instructional  prose  may  benefit  only 
a  portion  of  the  target  audience,  excluding  those  portions  of  the 
audience  that  are  poor  readers.     Third,  they  suggest  some 
additional   instruction   ( "sel  f -consci  ous-,  text,"  Pace,   1985)  that 
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may  be  included  alongside  content  instruction  that  will  aid 
learners  who  have  immature  text  processing  strategies*. 

Future  investigations  are  planned  to  examine  other 
implications  o-f  text  structure  cuing  and  strategy  use.  First, 
strategy  training  will  be  extended  to  include  instruction  using 
longer  passages  tl.at  ar*?  typical  o-f  the  passages  that  LD  students 
must  contend  with  in  content  area  class-^s.     Second,  content  area 
instruction  will  be  designed  to  teach  this  text  procrjci 
strategy  alongside  targeted  content  objectives.     The  ef-f *  .iency, 
effectiveness,   and  trans-f  erabi  i  ty  of  this  learning  will  be 
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Mmn  smrta  nn  Compreh<>ns<on  PfKttwt 


Oroup 


Passage  LD  NonLO 


Adversative                       8.000  11.269 

(3.406)  (1.710) 

0-21       •  n-26 

AUrlbullva                          "'.1 25  1C.958 

(^\604)  (1.899) 

n«i6  n-24 

Mt  Maximum  scotb  ■  15. 
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Group 


Passage  LO  NonLD 


Adversative                        21.063  40.615 

(10.871)  (H.577) 

0*21       .  0*26 

Allribulive                         24.095  41.375 

(11.749)  (18.939) 

0»16  n*24 

Total  number  of  Idee  units  *  1 59. 
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Table  3 


Group 


}M&  Total  number  of  idea  units  «  1 59. 


15 


LD  NonLD 


Adversativa                         M.500  30.654 

(11.599)  (12.652) 

D-21  •  Q»26 

Aitributiva                            17.571  31.042 

(12.385)  (15.708) 

n«t6  Q-24 
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Tabled 

tAPAn  Dwtirww nf  .Stnrliirft  tl<i^-lmtnPiriifl1i.  Qtt^W 


Group 


Passage  LD  NonLO 


Adversative  5.300  6.654 

(2.939)  (2.497) 

n»2i     *  n«26 

Allributiva  5.437  6.833 

(3.098)  (2.823) 

n«i6  a«24 
IMfi:  Ratings rangad from  1  (low)  to  10 (high). 
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Tabled 


Group 


Passage  LD  NonLD 


f^erstlim  4.500  6.654 

(2.893)  (2.497) 
D«21         *  D-26 

AllribuUvB  3.938  4.708 

(3.098)  (2.662) 

n*i6  n«24 

Ms,  Ralinfls  ranged  from  1  ( tow)  to  1 Q  ( high). 


Table  6 


Mmn  Niimher  of  Idea  Unit«;  RfirnHpd  hy  I  H  Siiirfpnls  »^  «  Ftinriinn  of  Structure  Use  and 

Passage  Type 


structure  Use  Rating 
Passage  Low*  Medium''  HigS^ 


Attributive 


Immediate 

16.60 

17.37 

33.25 

(6  39) 

(7.78) 

(ll.'t'O 

n-S 

n-8 

Dela/ed 

12.22 

7.00 

30.00 

(6.50) 

(3.16) 

(10.17) 

n=9 

n»4 

sative 
Immediate 

22.7! 

2329 

27.67 

(.6.02) 

(6.73) 

(11.96) 

n-7 

n«7 

n«6 

Oelff/ed 

12.50 

.19.80 

23.80 

(13.01) 

(8.70) 

(12.40) 

0*10 

a»s 

tlfllfi:  Total  number  of  idee  units  •  1 59. 

\ow  ratings  rengsd  from  1  to  3.  ''Medium  retings  ranged  from  4  to  7.  ^i^  retingi 
ranged  from  0  to  10. 
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Table  7 


Mean  Structure  Recognition  Seorat 
on  Poatteat  and  Delayed  Poatteat 


Traataent 


Reading  Level 
Low  (4.0  '  7.0) 
Poatteat 

M 

SD 
n 

Delayed  Poatteat 
M 
SD 
n 

Hleh  (7.1  -  10.0) 
Poatteat 

M 

SD 
n 

Delayed  Poatteat 
M 

SD 
n 


Bxparloental 


Ppntrol 


2.29 
.69 

17 

2.18 
.88 

17 


1.85 
.90 

13 

2.77 
1.09 
13 


.33 


.22 
.44 


0 
0 

IS 


.33 
.♦9 


|5 


Note;    Maxiaum  score  possible  •  3 


S2e 


t 
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Table  8 

Main  Idea  Units  Recalled  on  Posttest  and  Delayed  Posttest 


Treatment 

ExperlMntal  Control 

Reading  Level 
Low  (4.0  -  7.0) 
Postteat 

M  11.59  5.78 

SD  6.09  3.63 

n  17  9 
Delayed  Posttest 

M  12.23  5.22 

SD  6.76  3.77 

n  17  9 
High  (7.1  -  10.0) 
Poatteat 

M  16.0  6.87 

^  5.99  4.63 

n  13  15 
Delayed  Posttest 

M  12.85  6.27 

^  6.04  2.76 

n  13  15 


Note;    Maximum  score  possible  posttest  ■  150.    Maximum  score 
posalble  delayed  posttest  ■  128. 


ERIC 


S27 


Simulation 
1 


INSTRUCTIONAL  SIMULATION: 
RESEARCH,  THEORY,  AND  A  CASE  STUDY 
Peter  Smith 
School  of  Educatioii 
Seattle  Pacific  University 


A  Paper  Presented  to  the 
19  86  AECT  Annual  Conference 
January  1986 


ERIC 


B28 


I 


Simulation 


2 


INTRODUCTION 


Simulations  have  been  used  to  deliver  instruction  in 
educational,  military,  and  industrial  settings  for  many 
years.    Although  the  technique  has  repeatedly  been 
demonstrated  to  be  effective,  its  use  has  been  somewhat 
limited  in  higher  education  because  of  the  relatively  high 
costs  connected  with  the  development  and  presentation  of  the 
materials.    With  the  advent  of  computer  interactive  video, 
simulation  has  become  more  affordable  f  >r  everyone.  Thus, 
simulation  holds  great  promise  for  future  application  in 
many  instructional  settings.     This  presentation  will  focus 
upon  theory,  research,  and  practice  related  to  instructional 
simulations. 

Let  us  begin  with  a  definition  of  the  term  simulation. 
A  good  starting  poinc  is  to  look  at  the  way  the  term  is 
described  by  the  major  indexes  of  the  literature  of 
Education.  Two  indexes,  the  Current  Index  to  Journals  in 
Education  and  Resources  in  Education  include  the 
following  explanation  to  clarify  the  meaning  of  the 
descriptor  "simulation."  "Duplication  of  the  essential 
characteristics  of  a  task  or  situation."  An  examination  of 
the  literature  itself  reveals  that  most  writers  agree  with 
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the  indexes,  emphasizing  the  idea  that  simulation  indeed 
"duplicates  the  essential  characteristics"  of  reality. 
According  to  various  writers,  our  simulated  reality  may  be 
abstracted  and/or  simplified  (Heinich,  Molenda,  &  Russell, 
1985),  lifelike  (Cruickshank,  1S66) ,  and/or  controlled 
(Fink,  1973) . 

Simulations  do  more  than  merely  present  manipulated 
"realities,"  however.  In  addition,  they  call  upon  the 
learner  to  respond  through  decision-making  (Rice,  1966)  , 
problem  solving  (Cruickshank,  1966) ,  and/or  role  playing 
(Pollack,  1973).  Further,  participants  in  simulations  must 
deal  with  the  consequences  of  their  responses  (Spannaus, 
1978) . 

While  most  writers  appear  to  define  simulation  in 
slightly  different  terms,    common  element?  are  also  evident. 
Based  upon  definitions  from  the  literature,  the  following 
eclectic  version  is  offered:  simulations  are  controlled 
representations  of  real  situations,  calliv-^  tor  participants 
to  respond,  and  providing  some  form  of  feedback  to  those 
responses.     Instructional  simulations  are  those  simulations 
intended  to  result  in  predetermined  learning  outcomes. 

It  is  useful,  at  this  point,  to  make  a  distinction 
between  simulations  as  defined  above,  and  games.  Games  nave, 
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as  an  identifying  characteristic,  the  element  of  competition 
(CoombSr  1978;  Locatis  &  Atkinson,  1984),  Simulation  games 
are  ^lose  simulations  which  have  the  element  of  competition 
built  in  to  the  materials  and  processes.  It  will  not  be  the 
intent  of  this  paper  to  deal  directly  with  simulation-games, 
although  useful  and  appropriate  applications  to  games  may  be 
derived. 

This  work  will  deal  with  instructional  simulations  as 
used  in  higher  education,  and  will  focus  upon  applications 
in  the  arer  of  preservice  and  inservice  teacher  education. 
First,  a  brief  historical  review  will  be  presented, 
featuring  the  pioneering  v/ork  of  Bert  Kersh  and  associates 
at  the  Teaching  Research  Division  of  the  Oregon  State  System 
of  Higher  Education.    Then,  a  summary  of  research  will  be 
presented,  followed  by  a  snort  descriptive  analysis  of  how 
simulation  relates  to  reoresentative  elements  of  three 
learning  theories.        rationale  for  using  simulations  will 
be  offered  and  illustrated  with  a  case  study.     Finally  some 
directions  for  future  research  and  development  will  be 
proposed. 


631 


Simulation 


HISTORI^>L  OVERVIEW 


Simulations  have  been  successfully  used  for  many 
applications  in  military  training,    Richard  Braby  of  the 
Naval  Training  Device  Center  in  Crlando,  Florida  (Twelker, 
d970),  argues  convincingly  for  using  simulations: 

I  don't  thini;  we  could  ever  talk  a  pilot  into  having 
the  behavior  that  he  must  perform  in  the  aircraft.  You 
could  talk  to  him  for  30  years  and  he  would  never  be 
able  to  perform  under  the  stress  of  actual  flight.  In 
other  words,  in  the  classroom  you  don't  have  the 
stimuli  that  will  actually  trigger  the  behavior... I 
think  you  have  to  experience  it."  (p.  1) 

other  applications  from  the  military  have  included 
relatively  simple  simulations  such  as  "pocket  blinkers  which 
simulate  the  action  of  a  ship's  blinker  light  and  enables 
trainees  to  prac^ \ce  Morse  Code,  ...  to  exceedingly 
complex  weapons  systems  which  require  teama  of  operators  and 
analogue  or  digital  computers."  (Twelker,  1970,  p.  2) 

Likewise  in  industry,  simulations  have  been  used  to 
deliver  instruction.    A  good  example  is  the  flight  simulator 
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used  by  the  Boeing  Company  to  train  pilots.  These 
simulators  employ  sophisticated  computer  and  video  systems 
to  present  realistic  flight  situations  to  trainees. 
Procedures  ranging  from  normal  flighty  to  emergency 
situations r  can  be  simulated  to  provide  pilot-trainees  with 
very  realistic,  controlled  practice  environments. 

In  the  early  1960's,  Bert  Kersh  and  associates  at  the 
Oregon  State  System  of  Higher  Education's  Teaching  Research 
Division,  developed  and  conducted  research  using  a  sort  of 
educational  "link  trainer."  In  this  case,  the  simulation  was 
designed  to  help  preservice  teachers  develop  competencies  in 
classroom  management  techniques.     Later,  the  simulation 
techniques  were  extended  to  "discovery  teaching"  as  well. 

The  Teaching  Research  program  included  the  systematic 
study  of  three  simulation  packages  over  a  period  of  more 
than  eight  years.    Their  first  simulation  effort  wae 
intended  as  a  research  vehicle,  through  which  sufficient 
information  could  be  obtained  to  develop  further  materials. 
This  first  simulation  program,  "Mr.    Land's  Sixth  Grade," 
consisted  of  a  comprehensive  package  including:   (1)  an 
orientation  to  the  school  and  community,   (2)  individual 
records  on  each  student,  and  (3)  sixty  problem  situations 
presented  life  sized,  on  16mm  color  sound  films.  Students 
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engaged  in  simulation  training  were  placed  in  a  room  which 
was  arranged  to  look  exactly  like  an  elementary  classroom, 
complete  to  the  teacher's  desk  and  the  American  Flag. 
However,  instead  of  facing  a  class  of  actua]  children,  the. 
"teacher"  faced  a  large  rear  screen  upon  which  a  ssixth  grade 
classroom  full  of  children,  and  problems,  was  projected. 
Whenever  the  "teacher"  wanted  to  make  a  response,  the  film 
display  was  put  on  still  frame,  and  the  response  was  enacted 
in  exactly  the  same  manner  as  if  in  an  actual  classroom.  On 
the  basis  of  the  "teacher's"  response,  a  trainer/operator 
displayed  another  film  showing  the  class'  behavior  either 
improving,  or  getting  worpe. 

The  Kersh  group  conducted  many  eirperiments  on  the 
original  classroom  simulator,  providing  important  basic 
information  for  subsequent  researchers.     Results  will  be 
reported  later  in  this  paper.     Toward  the  end  of  the  60 's, 
additional  simulatiCi:i3  were  developed  and  field  tested.  It 
was  hoped  that  these  "Low  Cost"  materials,  dealing  wi^h 
classroom  management  and  discovery  learning  techniques, 
would  be  widely  disseminated.  Instead  of  employing  16mm 
films,  these  simulations  used  a  slide  and  audio  tape  format, 
with  accompanying  background  materials.     They  were  not 
developed  or  distributed  beyond  the  field  testing  stage. 
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During  the  60 's  others  were  also  experimenting  with  the 
use  of  simulation  in  teacher  education  programs,  Vlcek 
(1966),  and  Girod  (1969),  experimented  with  Kersh's 
classroom  simulation  materials  in  varied  settings,  Wynn 
(1964)  examined  simulations  for  teacher  education  using  an 
"inbasket**  technique.    College  students  role  playing 
elementary  school  pupils  were  the  basis  of  simulations 
developed  and  studied  by  Dettre  (1967)  and  Hershey, 
Krumboltz,  &  Shepard  (1965),     Here,  college  students  played 
the  part  of  elementary  pupils  to  give  practice  in 
"simulated"  teaching.    Like  Kersh,  Broadbent  (1967)  , 
Cruickshank  (1966),  and  Utsey,  Wallen,  &  Belden  (1966),  used 
16mm  films  to  present  simulated  classroom  situations. 
Broadbent 's  "Brockport  Simulation"  presented  32  teaching 
problems  set  in  a  fictitious  community.    Ten  of  the  problems 
were  presented  via  film,  the  remaining  ones  were  written 
materials.     The  stimulus  situations  were  intended  to 
sti'Viulate  group  discussions  of  possible  responses.  These 
materials  were  also  used  by  Cruickshank  (1966).  Utsey, 
et  al.,    (1966)  used  films  of  children  reading  to  give 
students  practice  in  assessing  reading  ability. 

Peer  teaching,  or  the  use  of  college  students  to 
simulate  elementary  school  classes,  continued  to  be  used  and 
studied  during  the  70 's.    E»nmer  (1970)  focused  on  elementary 
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education  situations;  Lehman  (1970)  on  the  teaching  of 
secondary  school  biology.  Simulated  situations  presented 
through  written  problem  descriptions  were  developed  by 
Zuckerman  (1979).     Situations  ranging  from  administrative 
tasks /  to  planning  activities ^  to  classroom  management^  were 
included*     Participants  received  feedback  from  simulation 
leaders  regarding  the  adequacy  of  their  responses.  Drawing 
from  the  work  of  his  colleagues  in  the  United  States^  Tansey 
(1970)    developed  successful  simulation  materials  for  a 
teacher  education  program  at  Berkshire  College  of  Education 
in  England. 

Computer  based  simulations  began  to  appear  during  this 
period.     Day  &  Parnes  (1975)  developed  programs  which 
provided  teacher  trainees  with  practice  in  making  "pupil 
behavioral  interventions."  Students  interacted  with  a 
computer  which  simulated  the  behavior  of  five  handicapped 
students. 

Another  computer  based  simulation  was  marketed  through 
the  CONDUIT  system.     This  program^  called  "School 
Transactions^"  was  described  as  follows:  "This  series  of 
simulation^  places  a  prospective  teacher  in  a  realistic 
school  setting  and  asks  him  to  solve  problems  involving 
students^  other  teachers^  parents^  and  administrators.  Each 
package  includes  three  to  five  different  simulations.  Using 
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these  slmu^  "^-lons/  teachers  can  explore  the  effect  of  ct 
variety  of  teaching  styles  and  strategies,"  {p.  18)  The 
materials  were  designed  to  run  on  Apple  Computers r  and  are 
curre  itly  available. 

So  far,  the  80 's  have  brought  Interesting  new 
developments  In  simulations  for  teacher  'Education,  For 
example^  an  entire  graduate  course  In  early  chlldnood 
education  was  taught  via  an  elaborate  simulation  (Harper, 
1980).  The  National  Center  for  Research  In  Vocational 
Education,  Ohio  State  University  (1982) ,  has  developed 
various  simulations  for  use  In  training  vocational  education 
teachers.     Included  In  the  materials  are  role  playing 
exercises r  In-basket,  case  study,  and  gaming  materials. 
Computers  continue  to  be  used  for  delivering  simulations. 
Strang  &  Loper  (1983)  describe  a  microcomputer  based 
simulation  program  In  which  the  teacher  trainee,  hereafter 
referred  to  as  "T,"  conducts  a  lesson  with  four  students 
whose  names  are  displayed  on  a  monitor.     T  questions, 
discusses,  etc.,  with  students  whose  graphically  designed 
hands  ^ Dp  up.     The  computer  based  simulation  Is  controlled 
by  an  operator  who  Is  a  physically  Isolated  from  T.  Each 
teacher-student  Interaction  Is  coded  Into  the  computer  by 
the  operator.    A  terminal  display  directs  the  operator 
regarding  how  to  respond  to  the  teacher.    The  pace  of  the 
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interaction  is  similar  to  reality^  due  to  the  fast  program 
routine /  c.id  operator  training.     Following  the  lesson ^  the 
teacher  is  furnished  with  a  hard  copy  printout  of  her/his 
"teaching  profile^"  pertaining  to  relative  amounts  of 
information ,  positive  affect ,  feedback ,  etc •     Two ,  twenty 
minute  sessions  are  included.    Another  microcomputer  based 
simulation  for  teacher  education  has  been  developed  by 
Schieman  &  Winn  (1983).    Here^  an  incident  is  presented  via 
vic?eo  which  is  stopped  at  a  decision  point.     The  user  is 
then  provided  with  alternative  responses.    After  a  response 
is  selected  and  entered  into  a  computer,  a  probable  response 
is  shown. 

Over  the  past  25  years ,  a  number  of  different  types  of 
simulations  have  been  incorporated  into  teacher  education 
programs.    Both  entire  courses ,  and  parts  of  courses  have 
been  presented  via  simulations.    Techniques  have  ranged  from 
in-basketSr  to  case  studies,  to  role  playing,  to  computer 
mediated  simulations.     Stimulus  situations  have  been 
presented  in  written,  filmed,  live,  and  computer  formats. 
Interest  has  remained  high  in  spite  of  the  rather  great 
amount   /f  time  and  expense  connected  with  the  development  of 
the  necessary  materials.     After  review  of  simulation  efforts 
during  this  period,  one  is  left  with  the  impression  that  the 
technique*  was  continually  used,  but  not  on  a  large  scale. 
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THEORY  AND  RESEARCH 


Any  instructional  materials  may  b^st  be  developed  if 
the  design  can  systematically  relate  those  materials  to 
instructional  theories.    One  advantage  of  simulation 
techniques  resides  in  the  extent  and  degree  to  which  they 
can  be  related  to  major  instructional  and/or  learning 
theories.     For  example,  when  Kersh  first  developed  his 
clessroom  simulation  materials  in  the  early  sixties /  he 
based  them  upon  a  bchavioristic,  operant  conditioning  model 
Later,  he  changed  his  orientation  to  an  information 
processing  framework  as  he  further  developed  his 
simulations.    This  illustrates  quite  nicely,  the  extent  to 
whicn  simulation  has  potential  connections  with  various 
theoretical  explanations  of  learning.     In  this  section  of 
the  paper,  some  of  those  connections  will  be  illustrated  by 
making  them  explicit.    As  a  footnote,  it  should  be  added 
that  space  and  time  do  not  permit  a  fully  extended 
explication  of  those  connections.     One  or  two  major  points 
of  support  will  be  identified  for  each  position. 

Briefly  stated,  operant  conditioning  theory  explains 
learning  in  a  stimulus,  response,  stimulus  (reinforcement) 
paradigm.     The  relationship  between  the  stimuli,  responses. 
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and  subsequent  reinforcing  stimuli^  represents  the  crucially 
important  relationship:  reinforcements  should  occur  rapidly 
and  on  predetermined  schedules  to  be  most  effective,  Here^ 
simulations  offer  some  special  and  unique  training 
advantages.     In  a  simulator #  reinforcements  can  occur  under 
conditions  controlled  by  an  operator/trainer.    They  can  be 
given  either  in  "real  time^"  cr  on  schedules  that  maximize 
their  ir  tructional  effect.     For  example^  in  the  natural 
setting^  a  reinforcement  may  not  occur  immediately,  but  if 
the  simulation  designer  believes  that  it  should  occur  right 
away,  this  can  be  built  into  the  simulation  sequence. 
Further,  because  simulations  can  exercise  students  through 
repeated  trials  of  any  problem  situation,  continued  and 
repeated  reinforcements  may  be  used  to  shape  behavior. 
Correct  responses  may  thus  be  rapidly  and  efficiently 
developed,  thanks  to  the  controlled  nature  of  the  simulation 
system. 

Turning  to  information  processing  explanations  of 
learning  we  now  find  an  emphasis  on  the  processes  involvf.d 
in  the  storage,  retrieval,  and  subsequent  use  of  information 
and  learned  skills  in  new  settings.     The  informational  value 
of  "reinforcements"  or  feedback  now  becomes  very  important. 
In  the  case  of  the  Kersh  materials,  the  feedbacks  provided 
by  the  simulator  were  originally  regarded  as  simply 
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"reinforcing  stimuli."  Kersh  came  to  believe ^  however^  that 
the  informational  value  of  feedback  was  very  important^  and 
developed  the  idea  of  "controlled  feedback,"  Now^  through 
prompts^  cues^  repeated  trials^  or  debriefing^  crucial 
information  contained  within  the  multiple  feedback  loops  of 
the  ongoing  instructional  situation  could  be  made  apparent 
to  the  viewer. 

Cognitive  approaches  to  the  learning  process  emphasize 
the  notion  that  learning  stems  from  a  basic  reorganization 
of  knowledge  which  occurs  within  the'  learner's  cognitive 
structures.    The  resultant  "insights"  are  characterized  by 
the  discovery  of  previously  unknown  relationships.    Often ^ 
such  insights  can  be  facilitated  when  reality  is  distorted^ 
when  situations  can  be  presented  in  compressed  time^  or 
through  other  techniques  which  make  new  relationships  quite 
apparent.  Simulations^  with  their  capacity  for  time 
compression  and  other  forms  of  reality  manipulation^ 
provide  unique  opportunities  for  new  perceptions  of 
reality.     These  can  lead,  upon  reflection  and  thought,  to 
the  insightful  discovery  of  new  relationships  and 
fundamental  changes  in  the  cognitive  structure. 

These  illustrative  examples  of  relationships  between 
simulation  and  learning  theory  are  indicators  of  the  degree 
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to  which  simulation  can  be  designed  to  follow  various 
theoretical  constructs.     Additional  cases  could  be  made  for 
connections  between  simulation  and  other  theories  as  well^ 
for  example  modeling/imitation^  social  learning  theories^ 
neurological  approaches ^  etc.  Clearly^  simulation  offers  a 
vehicle  for  instruction  which  can  be  studied  and  developed 
within  the  contexts  of  many  theoretical  frameworks. 

We  turn  now  to  a  review  of  the  research  conducted  on 
the  various  forms  of  simulation  employed  in  teacher 
education.  This  review  will  cover  a  twenty  five  year  period 
between  1960^  and  1985.     The  studies  will  be  organized  into 
three  basic  categories  according  to  their  major  focus:  (1) 
feasibility  studies ^  asking  the  question:  "can  simulations 
be  developed  and  operated  for  reasonable  costs?"/  (2) 
presentation  mode  studies ^  asking  the  question:  "in  what 
form(s)  so  simulations  work  best^  and  (3)  outcome  studies, 
asking  the  question:  "what  kinds  of  measurable  changes  in 
student  response  result  from  the  use  of  simulations?"  The 
reader  will  recognize  that,  as  in  most  category  systems , 
some  overlapping  occurs.     The  studies  cited  will  be  confined 
to  those  conducted  on  simulations  for  teacher  education. 
Exceptions  will  be  made  for  reports  summarizing  large 
programs  of  simulation  research ,  and  a  few,  selected 
simulaton  studies  from  other  fields  which,  in  my  opinion, 
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provide  special  information  relevant  to  simulations  in 
teacher  education  contexts. 


As  one  reviews  the  studies /  it  quickly  becomes 
apparent  that  relatively  few  have  focused  upon  the 
feasibility  question:  "Is  it  possible  to  produce  adequate 
and  reliable  simulations  for  an  acceptable  cost?"  During  the 
late  sixties f  Twelker  and  associates  at  Teaching  Research  in 
Oregon^  set  about  to  answer  this  question  by  developing  and 
field  testing  two  sets  of  simulation  materials.  Their 
objective  was  to  produce  "low  cost"  materials  which  could  be 
used  widely  in  teacher  education  programs.    According  to 
Twelker  (1970) 

The  original  "classroom  simulation"  materials  developed 
by  Kersh  (1963)  provided  students  with  an  opportunity 
to  react  in  a  lifelike  manner  to  film  sequences^  and  to 
experience  probable  pupil  consequences.    Although  quite 
effective,  these  pioneering  efforts  were  limited,  in 
terms  of  the  expense  of  materials  and  equipment,  and 
the  time  required  to  train  even  small  numbers  of 
students.    These  limitations  led  to  the  development  of 
"low  cost"  instructional  simulation  materials  for  use 
in  teacher  education  programs,   (p.  11) 
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Two  series  of  simulations  were  ultimately  developed^  the 
"Classroom  Management  Series^"  and  the  "Discovery  Teaching 
Series."  The  classroom  management  series  was  field  tested  at 
ten  sites  scattered  across  the  country.     The  Discovery 
series  was  not  developed  sufficiently  to  field  test. 
Results^  in  the  words  of  Twelker: 

...  revealed  that  the  Classroom  Management  Series 
left  little  to  be  desired  in  way  of  timliness  and 
credibility.    Designwise ,  improvements  were  indicated 
that  would  be  expected  to  have  a  significant,  positive 
effect  on  strength,  robustness,  reliability  and  affect 
created  by  the  system.     Data  revealed  that  the 
materials  did  not  cause  all  students  to  reach  expected 
proficiency,  and  affect  was  borderline  in  some  cases. 
The  system  was  found  to  be  manageable,   (p.  ii) 

While  the  system  did  not  prove  to  be  as  effective  as  hoped 
or  planned,  improvements  were  indicated  that  were  expected 
to  have  positive  effects  on  the  "strength,  robustness, 
reliability,  and  affect"  created  by  the  system.  Twelkor 
indicated  that  such  changes  would  "not  be  impossible  to 
perform,"  and  that  they  "should  not  be  ignored."   (p.  102) 
In  spite  of  this,  however,  no  further  changes  were  ever  made 
upon  the  materials,  nor  were  they  redeveloped  or 
disseminated. 
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Thirteen  years  later ^  i    1983^  Schieman  and  Winn 
developed  and  field  tested  three  simulations;  "Music/' 
"Management/*  and  "Counseling."  Critical  incidents  were 
presented  via  an  interactive  videotape  ssystem.  After 
viewing  a  stimulus  situation  presented  by  vid^^otape,  the 
student  entered  x  response  into  a  microcomputar ^  and  a  video 
sequence  showing  a  probable  response  was  presented.     In  t>^ 
words  of  the  authors^  "...the  results  of  the  formative 
evaluation  were  very  encouraging.    All  three  simulations 
rece*^*  ad  high  ratings  on  attitude,  realism  and  technical 
quality."  (n.  330)     After  the  development  of  the  materials 
had  been  completed ,  they  were  evaluated  once  nore  as 
complete  packages  by  an  external  evaluator.    Again ,  in  wHe 
words  of  the  authors  "...we  were  pleased  to  conclude  that 
all  three  simulations  were  convincing ,  wexl  liked,  and  for 
the  most  part  successful  in  achieving  what  they  set  out  to 
do.     (p.  331)     Some  limitations  were  noted  with  the  relative 
slow  speed  of  tapo  access,  and  a  few  participants  indicated 
that  they  would  have  preferred  more  interaction  with  the 
materials.    However,  in  general  the  findings  of  the  field 
test  were  positive  and  encouragimj . 

Buehning  and  Scoieman  (1983)  developed  a  classroom 
simulauor  for  music  teachers.    As  in  the  previous  study, 
this  simulation  was  prec*^nted  through  an  interactive  video 
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tape  format.     Speaking  to  the  feasibility  question^  they 
reported: 

An  evaluation  conducted  by  an  outside  examiner 
revealed  its  effectiveness  and  indicated  that 
the  strategy  can  and  should  be  an  integral  part 
jf  teacher  training  programs.    This  project 
demcnstr^»tes  that  available  technology  can  be 
used  to  structure  and  deliver  instruction  in 
human  interaction,   (p.  55) 

Related  to  the  question  of  feasibility  is  the  matter  of 
t\e  time  required  for  students  to  complete  simulation 
training.     Simulations  have  been  criticized  on  the  grounds 
that  they  take  more  training  time  than  "conventional" 
instruction.    Coleman  (1973)^  in  summa::izlng  the  Hopkins 
Game  Research,  revealed  that  indeed  siirulation  training  does 
take  pore  time  than  instruction  using  an  "information 
processing"  (morp  conventional )  approach. 

If  simulations  can  be  designed  to  reduce  training  time, 
then  their  feasibility  is  enhanced.     Two  studies  of 
classroom  simulation  have  directly  invesL^gated  this 
quesrion.     In  the  first  study,  Twelker  (19C5)   found  that 
prompts  made  simulations  more  efficient,  in  the  second  study 
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Girod  (1969)^  comparing  audio  tapes  with  filmed  versions  of 
simulated  materials,  found  that  the  training  time  was 
reduced  using  the  audio  tape  version.    These  data  suggest 
that  simulations  can  be  designed  for  reduced  instructional 
time,  thereby  increasing  their  feasibility  relative  to  other 
instructional  modes . 

In  at  least  two  cases  involving  simulations  developed 
for  teacher  eaucation  settings,  Broadbent's  "Brockport" 
simulation  (1967),  and  the  Conduit  simulations  (1985), 
material    have  been  disseminated  through  commercial 
publishing  houses.    Although  no  experimental  test  of 
feasibility  can  be  reported  on  these  materials,  one  assumes 
that  their  continued  civailabiliw/  through  private,  for 
profit  concerns,  demonstrates  cost  effectiveness. 

In  summary,  we  would  noce  that  while  the  early 
attempts  toward  "low  cost"  simulation  by  Twelker  and 
associates  was  not  successful,  subsequent  simulations  have 
been  successfully  developed  and  disseminated.  Simulations 
have  a  potential  for  efficient  instruction,  with  the  most 
recent  versions,  based  on  interactive  video  formats, 
showing  particular  promise  for  continued  low  cost 
development. 
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Presentation  Modes 


A  number  of  studies  have  sought  to  compare  various 
alternative  methods  of  presenting  simulations  in  teacher 
education.    Girod  (1969),  compared  film  and  audio  tape 
versions  of  classroom  simulation  materials  dealing  with 
classroom  management.    He  found  that  the  audio  tape  version 
required  fewer  learning  trials  to  criterion,  but  his 
subjects  generated  a  greater  number  of  errors  in  responding. 
In  another  comparative  study,  Hershey,  et  al.  (1965), 
conducted  an  experiment  designed  to  look  at  the  effects  of 
observations  in  a  real  class,  compared  with  simulated 
teaching  (students  teaching  other  students)  on:  course 
gra<^es,  final  exam  scores,  attitudes,  career  plans,  ability 
to  apply  psychological  principles,  and  general  coui 
satisfaction.    While  he  found  no  significant  differences 
between  his  training  conditions,  his  subjective  evaluation 
was  that  the  live  observations  had  a  more  general  benefit, 
while  the  simulations  were  better  suited  for  the  development 
of  particular,  specific  skills. 

The  degree  of  fidelity  that  is  optimal  for  effective 
simulations  has  been  a  question  of  interest  to  several 
researchers.    Guetzkow  (1962) ,  in  summarizing  simulations 
developed  in  military  settings,  concludes  tl at  "In  general, 
(these)  experiments  ...  show  that  high  fidelity  simulations 
...  are  not  necessary  for  high  positive  transfer."  (p.  40) 


ERLC 


simulation 
22 

One  of  the  more  systematic  investigations  of  the 
effects  of  filelity  in  simulations  was  conducted  by  Bert 
Kersh  (1965)  .     Kersh  studied  the  following  dimensions  of 
what  was  called  "realism:     (1)  image  size:  life  sized  vs. 
small   (2)  feedback  mode:  visual  vs.  verbal   (3)  response 
mode:  enactment  oZ  responses  vs.  verbalization  of  response, 
and  (4)  orientation  to  simulation:  large  life  sized 
projections  vs.  small  projections.    Various  combinationc  of 
simulation  conditions  were  tried,  ranging  along  a  dim^^nsion 
labelled  "realism."  The  most  •'realistic'*  training  c.  -  itions 
were  those  in  which  the  trainees  received  life  sized 
projected  materials  during  their  orientation  sessions,  and 
enacted  responses  to  life  sized  projections  of  problem 
Situations.    At  the  other  extreme,  students  receiving  "non 
realistic"  training  had  an  orientation  consisting  of  small 
images,  then  responded  to  situations  presented  by  slides,  on 
a  small  screen,  by  verbally  describing  what  they  would  do. 

Students  undergoing  simulation  training  under  varying 
conditions  ranging  from  "nonrealistic"  to  "realistic"  were 
compared  in  terms  of  performance  on  a  post  test  consisting 
of  response  quality  to  simulated  situations.     Kersh  found  no 
significant  diffe.     ces  on  most  of  the  variables  he 
examined,  with  the  exception  of  tne  large  versus  small  sized 
projections  for  orientation.     Here,  he  found  a  slig  t 
difference  in  favor  of  the  small  sized  "nonrealistic"  mode. 
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His  overall  conclusion  was  that  "realism"  was  of  relatively 
minor  importance.    An  interesting  sidelight  to  this  study 
was  that  further  analysis  uncovered  the  fact  that  all 
subjects  were  able  to  achieve  the  same  level  of  performance 
regardless  of  entry  level.     It  appeared  that  simulation 
could  have  equalizing  effect  in  bringing  students  with  with 
widely  varying  backgrounds  to  similar  levels  of  attainment. 

Using  the  Kert>ii  materials^  Twelker  (1?65)  investigated 
the  effectiveness  of  various  types  of  prompts  given  to 
subjects  as  they  proceeded  through  simulation  training. 
In  this  study r  two  types  of  prompts  were  compared  to 
training  with  no  prompts.     In  one  treatment^  subjects  were 
given  prompts  which  would  help  to  identify  the  problem 
presented  in  the  simulated  episode^  in  the  second^  subjects 
received  prompts  which  would  help  them  generate  a  correct 
response.    The  prompts  were  of  a  general,  rather  than 
specific  nature.    Training  including  one  or  both  types  of 
prompts  was  compared  with  that  in  which  no  prompts  were 
presented.     Dependent  variables  included  training  session 
length,  post  test  performance,  and  affect.     Twelker  found 
that  "problem  identification"  prompts  had  unmeasurable 
effects.     The  "response"  prompts  had  the  effect  of 
shortening  the  time  necessary  for  trainees  to  reach 
criterion. 
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In  summary^  it's  not  surprising  that  dimensions  of 
realism  have  been  studied.     It  may,  however ,  be  surprising 
to  some,  that  the  "realism"  or  fidelity  of  a  situation  has 
not  been  demonstrated  to  have  universally  any  strong  c^ffects 
to  date.    Perhaps  the  important  "reality"  factor  for  those 
simulations  designed  to  develop  cognitive  abilities  is  less 
related  to  the  form  of  the  stimulus  materials  than  to  the 
form  of  the  essential  decision-making  dynamic  which 
underlies  the  simulation  process.    To  my  knowledge,  this 
"cognitive  realism**  has  not  been  explored. 

It  is  also  not  surprising  that  some  varieties  of  • 
prompting  would  be  effective  in  view  of  the  value  they  have 
demonstrated  in  other  media-related  studies.     Insofar  as 
presentation  >^ariables  are  concerned,  research  on  "classroom 
simulation"  to  date  would  seem  to  indicate  that  the 
fidelity  of  the  presentation  materials  may  not  be  as 
important  as  variables  related  to  the  instructional 
process,  such  as  prompting. 


At  this  point,  Jet  us  turn  to  studies  focusing  upon  the 
outcomes  of  simulation  training.     Three  broad  categories  of 
outcomes  will  be  considered.     In  the  first,  the  lower  levels 
of  the  Bloom  (1956)  Taxonomy,  "knowledge  and  comprehension" 
will  be  emphasized.     The  relevant  question  here  is  whether 
simulations  can  teach  students  facts,  principles,  and 
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responses.    The  second  levels  which  roughly  corresponds  with 
the  "analysis"  level  of  Bloom^  deals  with  outcomes  related 
to  the  discrimination  of  cues^  and  the  identification  of 
problems.     Finally^  the  third  category  will  be  concerned 
with  those  studies  which  have  explored  the  extent  to  which 
simulations  have  led  to  Bloom's  "application"  level,  or 
transfer  of  what  was  learned  into  actual  classroom  settings. 
It  is  perhaps  this  latter  category  which  is  the  most 
important,  because  it  speaks  to  c.  major  reason  why 
simulations  are  claimed  to  be  used:  to  increase  one's 
ability  to  respond  appropriately  in  actual  settings. 
Perhaps  this  is  why  the  great  majority  of  the  studies  deal 
with  the  application,  or  transfer  question,  a  comparatively 
smaller  number  deal  with  knowledge  and  analysis. 

We  begin  our  review  with  a  consideration  of  those 
studies  which  have  looked  at  the  Bloom  "knowledge  and 
comprehension",  levels.    Cnerryholiues  (1966)  after  reviewing 
six  simulation  studies,  rejected  the  hypothesis  that 
students  would  learn  more  facts,  and  retain  them  longer 
using  simulations  as  compared  with  "conventional  classroom 
activities."  Coleman  (1973)  reported  contrary  findings  in 
that  he  found  that  students  using  simulations  had  an 
increased  ability  to  learn  facts. 
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When  we  turn  to  the  matter  of  learning  specific 
responses,  the  data  are  more  clearly  positive.    Both  Twelker 
(1965,  1970)  and  Kersh  (1965)   reported  that  students  were 
able  to  learn  "correct"  responses  during  training,  and 
exhibit  them  later  on  post  tests.     Since  they  presented 
problems  novel  to  the  students,  these  post  tests  could  also 
be  considered  as  tests  of  trar^^fer  as  well. 

Moving  up  the  Taxonomy  to  "analysis,"  tive  studies  will 
be  reported.     Kersh  (1965),  and  Twelker  (1965),  found  that 
their  original  classroom  simulation  materials  were  effective 
in  teaching  students  valuable  cue  discrimination  skills. 
Students  were  able  to  pick  out  the  information  necessary  to 
identify  the  problems  which  were  presented. 

Similarly,  u-'ing  variants  of  the  Kersh  materials,  Girod 
(1969)  reported  that  his  subjects  were  increasingly  able  to 
discriminate  cues  necessary  to  identify  simulated  problems. 
However,  in  contrary  findings,  Vlcek  (1966)  reported  that 
simulation  did  not  demonstrate  any  greater  ability  to 
develop  problem  identification  skills  when  compared  with  no 
training  at  all.    This  was  true  regardless  of  whether  the 
problems  were  presented  via  simulations,  or  in  actual 
classrooms. 
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This  brings  us  to  the  studies  which  have  explored  the 
applicability^  or  transfer  of  simulation  training  to  actual 
settings,     Kersh  (1965)^  investigated  the  transferability 
of  simulation  training  to  actual  classrooip  practices • 
Unfortunately^  he  had  to  abandon  his  attempt  to  answer  this 
cjj'tstion  because:   (1)  there  was  a  one  year  interval  between 
the  time  his  subjects  received  simulation  training  and  when 
they  were  in  actual  teaching  situations ^   (2)  he  had  no 
readily  available  instrument  through  which  he  could  measure 
simulation's  effects  in  a  classroom,  and  (3)  he  had  no 
control  group  against  which  his  simulation  trained  students 
could  be  compared.    Although  he  was  unsuccessful  in 
measuring  the  extent  of  transfer ,  he  did  circulate  a 
questionnaire  to  supervising  teachers  which  revealed  that 
students  having  had  simulation  training  were  judged  as  being 
able  to  take  over  classes  weeks  earlier  than  students  who 
had  not  received  such  training. 

In  a  field  test  of  Kersh 's  materials  at  Michigan  State 
University,  Vlcek  (1966)  reported  that  students  undergoing 
sii.iulation  training,  as  opposed  to  students  having  no  such 
training,  were  more  able  to  solve  simulated  problems,  but 
were  not  better  problem  solvers  in  actual  classrooms. 

Using  a  set  of  materials  entitled  the  "Brockpc-t 
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Simulation^"  Broadbent  (1967)  reported  informal  findings 
indicating  that  simulation  students  developed  increased 
problem  solving  abilities.    Likewise,  Ryan  (1965,  1968) 
found  that  when  students  solved  problems  presented  via 
simulations,  they  exhibited  an  increased  ability  to  solve 
problems  in  real  settings.     She  concluded  that  practice  in 
problem  solving  under  realistic  conditions  should  be  given, 
particularly  in  specially  created  situations  where  students 
could  apply  their  newly  acquired  knowledge. 

Using  the  Kersh  materials,  Twelker  (1965)  found  that 
students  were  able  to  learn  and  apply  correct  responses  to 
new  situations  presented  via  simulations.    Later,  in 
reporting  the  results  of  his  field  testing  of  the  "low  cost" 
simulation  materials,  r-^.     er  (1970)  indicated  that  although 
he  was  not  able  to  demonstrate  that  his  system  changed  the 
classroom  behavior  of  student  teachers,  he  was  encouraged 
enough  to  speculate  that: 

It  is  heartening  to  note  that  the  research  of  Forgan 
(1969)  supports  the  intuitive  hunches  that  simulation 
bridges  the  gap  between  the  textbook  and  the 
operational  situation.     In  fact,  the  ability  of  the 
system  to  change  behavior  in  the  classroom  leads  this 
writer  to  speculate  that  the  objectives  stated  in 
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Chapter  II  may  be  too  rigid  ...  and  should  be 
relaxed...   (p.  101,  102) 

Emmer  (1970)  studied  a  peer  teaching  simulation 
experience  to  see  if  benefits  would  transfer  to  the 
teaching  of  actual  pupils.    He  determined  that  transfer  did 
indeed  occur.     Similarly,  Zuckerman  (1979)  investigated 
transfer  with  his  simulation  program  called  "Hey  Teach." 
Preservice  teachers  were  given  practice  in  four  areas: 
(1)  administrative  tasks,   (2)  planning  ta&ks, 
(3)  implementation  of  instruction,  and  (4)  classroom 
management.     Informal  reports  from  supervising  teachers  were 
that  students  who  had  received  the  "Hey  Teach"  program  were 
better  able  to  handle  real  classroom  tasks. 

Although  the  following  study  did  not  specifically  deal 
with  simulations  used  in  teacher  training  contexts,  they  are 
included  here  because  of  their  great  general  value.  Both 
Coombs  (1978) ,  and  Coleman  (1973) ,  summarize  the  long  term, 
systematic  research  program  in  simulation/games  carried  on 
by  the  Center  for  Social  Organization  at  Johns  Hopkins 
University.    After  reviewing  this  extensive  body  of 
research.  Coombs  (1978)  concluded  that:   (1)  simulations  can 
transmit  factual  information,  but  not  better  than  other 
modes,   (2)  simulation  does  not  seem  to  be  a  particularly 
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good  way  to  teach  cognitive  skills f   (3)  simulation  games 
alter  the  character  of  a  class  in  a  positive  manner ^  and  (4) 
simulations  improve  the  motivation  of  students. 

In  sumr'^'Y/  we  find  that  when  simulations  are  used  to 
instruct  students  in  factual  inf ormation^  the  evidence  is 
mixed  regarding  their  effectiveness.     However /  indications 
are  that  simulations  can  develop  the  capacity  of  students 
to  give  specific  responses.    Similarly/  although  by  no 
means  overwhelming ^  the  experimental  findings  suggest  that 
simulations  can  be  successful  in  teaching  problem 
identification  skills.    Turning  to  transfer  in  problem 
solving /  we  find  most  of  the  studies  indicating  that 
simulation  is  effective  in  leading  students  to  greater 
problem  polving  abilities. 

Affective  Outcomes 
Affective  responses  to  simulation  training  have  also 
been  widely  studied.    These  fall  into  three  categories:  {!) 
attitudes  toward  the  simulation  instruct** ^^n^   (2)  attitudes 
toward  the  subject  of  the  simulation,  and  (3)  attituc .s 
toward  self. 

Wi  a  regard  to  attitudes  toward  simulation  instruction, 
in  his  review  ^  c-mparing  six  simulation  studies  with 
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"conventional  classroom  activities,"  Cherryholmes  (1966) 
asserted  that  students  participating  in  a  simulation 
exercises  showed  more  interest  in  inrtructional  act:ivities, 
and  more  readily  had  significantly  altered  attitudes. 

Cherryholmes'  findings  were  later  confirmed  by 
Cruickshank  (1966) ,  who,  after  studying  forty  students 
receiving  31  simulated  critical  incidents  during  the  first 
two  weeks  of  student  teaching,  reported  that  students 
reported  grearer  satisfaction  and  ability  to  cope  with 
teaching  problems  and  preferred  the  (simulation)  laboratory 
to  starting  student  teaching  two  weeks  earlier. 

Similarly,  Broadbent  (1967)  reported  that  students  who 
had  completed  his  "Brockport"  simulation  program  rated  it 
favorably,  and  "learned  about  Lhemselves,  their  methods  of 
reacting  to  attacking  problems,  and  their  relationships  to 
students."   (p.  42) 

Reporting  contrary  findings,  Twelker  (1970),  found  some 
difficulties  with  his  low  cost  simulation  materials  in  their 
ability  to  hold  t-he  interest  of  students.    He  concluded  that 
"The  ability  of  the  system  to  attract  and  hold  the  interest 
of  the  target  audience  seems  marginal."  (p.  99)  However,  he 
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also  noted  that  attitudes  were  not  unfavorable,  "It  could  be 
concluded  that  although  there  xs  room  for  improvement, 
affect  was  not  negative."   (p.  99) 

Buehning  and  Schiei^an  il983)  concluded  that  through 
their  classroom  simulation  for  music  teaciers-  "we  prodi  i.ed 
a  simulation  that  was  both  highly  motivating,    or  zLe 
participants  and  iii*.tru  ^tionally  meaningful,"   (p,  55)     In  an 
article  entitled  "Changing  Attitudes  with  the  'School 
gritne,'"     .w^mmer  (1973)  reported  that  this  simulation 
exercise  ''generated  positive  affect."     (p.  46)  However, 
although  che  students  seemed  to  er^jy  the  exercise,  they  did 
not  view  it  as  one  which  provided  learning. 

In  agreement  with  mort  of  the  research,  Hershey  et 
al.,   (1965)  measured  stuaent  affective  responses  to 
"simulated"  teac>^ing  (students  teachina  oxhf^r  students)  ,  and 
concluded  that  ctudent  satisfaction  with  the  course  was 
enhanced  through  sinulations. 

Harper  (1980)  took  the  i '^vel  approach  -^f  teaching  an 
entire  graduate  s^ourse  through  simulations,     ile  noted 
several  ?dvantages,  among  which  was  a   'high  degree  of 
student  involvement      Moreover,  he  reported  that  his 
studr*.ts  rated  the  simulation  course"  over  lecture  VTersions. 
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However,  he  also  noted  that  some  individuals  vrere  very 
critical  of  the  simulation  course. 

A  study  by  Bond  (1965)  investigated  the  effects  of 
classroom  simulation  on  the  attitudes  of  education  majors 
toward  topics  in  er^ucational  psychology.    He  reported  "In 
general,  the  findings  of  the  project  are  not  suf f icient-iy 
conclusive  co  permit  any  clear  cut  recommendations  of 
procedure  on  the  use  of  simulation  to  influence  attitudes  of 
education  r^ajors  toward  professional  course  content." 
(p,.  17)     However,  he  also  indicated  that  informal  statements 
of  evaluation  justv.ry  continued  research  in  the  area. 

In  his  evaluation  of  the  Hopkins  Game  Program,  Coleman 
(1S73)  concluded  that  students  undergo  a  change  of  attitude 
toward  the  real  life  persons  whose  roles  they  assume  in  the 
simulation.     This  change  of  attitude  is  positive,  but  may  be 
short  lived.     The  more  concrete  the  simulation  game,  the 
more  stiongly  the  attitude  change  effect  seemed  to  be. 

Two  researchers  found  an  enhancement  of  a  student's 
s*=*lf  confidence  as  an  effect  of  simulation  training.  Vlce\ 
(1966),  using  Kersh's  materials,  found  an  increase  in  the 
self  confidence         tudent  teachers.     Similarly,  xn  a  much 
more  recent  study,  Schieman  and  Winn  (19  83)  reported  that 
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among  other  advantages  of  their  system^  students  had 
increased  confidence  in  their  teaching  ability,  finally, 
studies  by  both  Broadbent  (1967)  and  Kershey,  et  al,,  (1965) 
reported  increases  in  student  "self  knowledge"  coming  from 
simulation  training. 

In  summary^  I  report  that  the  overwhelming  evidence 
points  to  a  high  degree  oi  student  satisfaction  with 
simulaton  training.    With  few  exceptions/  students  report 
favorable  attitudes  toward  simulation.     The  studies  are 
somewhat  less  clear  on  whether  these  favorable  attitudes 
extend  to  entire  courses ^  subject  matters ,  and  even 
perceptions  of  subject  content  areas  such  as  educational 
psychology.     Simulations  do  appear  to  have  the  potential  of 
developing  favorable  attitudes  toward  any  roles  and 
positions  simulated.     Finally,  students  report  increas  d 
self-knowledge  and  self  confidence  accruing  from  simulation 
training. 

Conclusions  From  the  Research 
Before   any  jonclusions  can  be  drawn  from  these  data, 
some  important  qualifications  should  be  noted.     First,  the 
studies  cited  represent  a  mix  of  methodological  approaches. 
Many  reported  findings  ere  "informal.'*  Furthermore, 


ERIC 


Simulation 
35 

although  classroom  simulation  has  been  studied  in  several 
different  contexts^  few  efforts  have  been  attempted  to 
systematical ly^  and  over  a  long  term^  investigate  variables 
connected  with  the  technique.     For  !.hese  reasons,  any 
conclusions  must  be  viewed  as  tentative,  certainly  not 
definitive.    With  these  reservations  noted,  I  list  the 
following  preliminary  conclusions; 

1.  Simulations  have  the  potential  of  developing  the 
capacity  of  students  to  learn  specific  responses  to 
given  situations. 

2.  Simulations  have  the  potential  of  developing  the 
capacity  of  students  to  identify  and  solve 
problems. 

3.  In  the  desxgn  of  simulation,  factors  related  to  the 
physical  fidelity  of  the  materials  to  the  physical 
situation  may  be  less  important  than  the  degree  to 
which  the  simulation  models  and  exercises  students 
in  realistic  problem  solving  processes. 

4.  Simulations  are  costly  to  pioduce,  but  do  have  a 
potentiel  for  efficient,  low  cost  applications, 
particularly  when  delivered  /ia  interactive  video 
formats. 

5.  Students  enjoy  simulation  exercises. 

6.  Students  report  higher  levels  of  self  understanding 
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and  greater  confidence  after  receiving  simulation 
training. 

After  reviewing  the  studies  of  simulations  used  in 
teacher  education,  my  overwhelming  impression  is  that  many 
more  questions  are  raised  than  are  answered.     Some  of  the 
questions  for  future  research  will  be  given  in  the  final 
section  of  this  report. 


RATIONALE 


We  have  seen  that  simulations  have  been  successfully 
employed  in  many  different  teacher  education  applications. 
We  have  also  seen  that  the  development  of  simulation 
materials  can  occur  within  a  framework  drawing  upon  several 
learning  and  instructional  theoretical  perspectives. 
Finally,  the  research  conducted  to  date,  while  spotty  and 
incomplete,  doee  suggest  that  simulations  can  be  used 
successfully       the  development  of  higher  level  cognitive 
abilities,  notably  problem  solving,  and  that  simulations  are 
viewed  favorably  by  students. 


In  his  now  classic  wojk  entitled  "Readiness  for 
Learning,"  Bruner(1960)  characterizes  the  instructional 
process  as  proceeding  through  three  phases:  acquisition. 
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transformation^  and  evaluation.    Briefly^  acquisition 
concerns  precisely  what  the  name  suggests^  the  acquisition 
of  inforraation.     This  correlates  to  the  lower  two  levels  of 
the  Bloom  (1956)  taxonomy.     During  this  phase,  the  emphasis 
is  upon  the  gathering,  storage,  and  retrieval  oZ 
information.     In  "transformation, "  learners  "manipulate;" 
knowledge  to  make  it  fit  new  tasks.     In  terms  of  tbe  Bloor 
taxonomy,  operations  such  as  "analysis,"  "synthesis,"  a^^d 
"application"  occur.    Finally,  during  the  phase  of 
"evaluation,"  learners  judge  whether  the  way  thej  have 
manipulated  information  is  adequate  tc  the  task.  This 
corresponds  witn  Bloom's  "evaluation"  level.  Bruner 
indicates  that  "in  the  learning  of  any  subject  matter, 
there  is  usually  a  series  of  episodes,  each  episode 
involving  the  three  processes."  (i .  421) 

In  which  of  these  phases  might  simr.lations  most 
properly  be  employed?    The  answer  is  not  absolute  by  any 
means,  because  simulations  have  been  used  to  support  all 
three.    However,  it  is  in  the  "transformation"  and 
"evaluation"  stages,  thai  the  greatest  degree  of  success  has 
been  attained.    At  least,  che  literature  discribinq  uses  of 
simulations  in  teacher  education  contexts  would  suggest 
this.    Simulations  seem  particularly  suited  t:o  providing 
practice  in  cue  discriminaton,  and  problem  solving. 
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Put  in  the  context  of  preservice  teacher  education^ 
simulations  might  best  be  employed  then,  as  a  bridge  between 
the  facts,  principles,  ana  skills  learned  in  educational 
foundations  classes,  and  the  experience  of  serving  in  an 
actual  classroom  as  a  student  teacher,  or  intern.  In 
reviewing  the  applications  of  simulations  in  teacher 
education,  it  is  not  surprising  to  find  that  this  is 
precisely  the  point  at  which  most  simulations  have  been 
employed. 

.ulations  are  useful  net  only  for  pre:,  rvice,  but 
inservice  teacher  education  as  well.    Here,  practicing 
teachers  may  have  opportunties  to  try  out  new  instructional 
procedures,  and  sharpen  their  discriminatory  skills  in 
simulated  s<;ttings.    Again,  the  "transformation"  and 
"evaluation"  phases  as  described  by  Bruner  seem  to  be 
appropriate  points  in  the  learning  process  to  employ 
simulation. 

Might  we  conclude  that  simuiations  have  no  place  in  the 
initial  acquisition  of  information?    Not  necessarily, 
although  few,  if  any,  examples  of  the  technique  being 
successfully  employed  in  such  settings,  at  leasu  in  Leach^r 
education  programs,  seem  to  exist. 
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their  optimal  format  seems  to  be  related  to  the  nature  of 
the  objectives  connected  with  instruction.    At  least  in 
teacher  education ^  we  have  some  evidence  that  high  degrees 
of  fidelity  of  stimulus  situations  may  not  be  as  crucial  a 
factor  in  designing  successful  simulations  as  faithful 
•eplicr»tion  of  problem  solving  processes.  Therefore^ 
"reality"  may  be  presented  via  3mall  screens ^       \  subjects 
may  not  be  required  to  act  out  their  responses  as  if  in  the 
actual  situation.    Insofar  as  the  problem  solving  process 
is  exercised,  simulatons  might  be  successfully  presented  by 
video  and  require  verbal  or  written  responses. 

It  is  important  to  note,  however ,  that  the  episodes 
must  be  believable,  if  not  projected  in  life  sized  images. 
Believability  requires  that  the  problems  be  realistic,  that 
possible  decisions  be  reasonable,  and  that  sufficient 
information  be  available  for  decisions  to  be  made. 
Furthermore,  the  feedback  to  the  learner  must  be  such  that 
there  is  little  question  tha^  such  feedback  would  indeed 
occur  in  the  real  situation.     It  is,  then,  the  integrity  ot 
the  materials  which  is  most  important.     The  integrity  and 
"reality"  of  the  decision  making  process  which  seam 
essential  for  a  successful  simulations. 

As  is  true  for  most  Instructional  materials,  the 


simulation 


40 


evaluation  of  simulation  training  systems  should  include 
both  cognitive  and  c^ffective  elements.     In  the  cognitive 
area,  any  factual  material  which  is  presented,  and  which  the 
student  is  required  to  remember,  should  be  measured  lo  see 
if  it  is  presented  in  a  clear  fashion.    Similarly,  if  cue 
discrimination  is  an  objective,  this  should  be  measured  as 
well.    Most  simulations  are  designed  to  exercise  students 
through  problem  solving  strategies,  so  the  degree  to  which 
the  materials  develop  problem  solving  skills  should  be 
considered.    A  simulation  is  supposed  to  lead  to  improved 
performance  in  actual  situations,  so  tests  of  transfer  to 
actual  setting!  should  be  included  in  most  evaluations  of 
simulation  training.    As  in  virtually  any  training  package, 
attention  should  be  paid  to  the  objectives  when  designing 
evaluation  instruments. 

Similarly,  affective  outcomes  should  be  a  part  of 
regular  evaluation.  Here^  the  student's  attitudes  toward  the 
simulation  training  situation,  and  toward  the  general 
discipliaary  content  should  be  monitored. 

The  feasibility  rjnention  becomes  important  in  many,  if 
not  most,  applications  of  simulations.  The  costs  for 
developing  and  operating  simulations  should  be  monitored, 
with  procedures  and  techniques  for  reducing  them  thoroughly 
explored. 
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A  CASE  STUDY 

Last  winter^  I  set  about  to  develop  some  simulation 
materials  for  use  in  the  preservice  teacher  education 
program  at  Se?*^''^  Pacific  University.     It  was^  and  remains^ 
my  hope  that  a  continuing^  systematic  program  of  research 
and  development  in  simulation  will  be  undertaken  at  Seactle 
Pacific^  and  that  the  present  materials  represent  the  v<3ry 
first  beginnings  of  that  program. 

This  case  study  will  summarize  the  development  of  a 
prototype  clasiroom  simulation  system,  from  initial 
development,  through  field  testing.     It  is  hoped  that  it 
will  serve  to  illustrate,  in  a  concrete  way,  the  way  in 
which  simulations  can  br  developed  and  used  in  higher 
educaton.     This  account  will  be  given  in  five  parts:   (1)  a 
description  of  the  background  situation,   (2)  questions 
to  be  answered,   (3)  a  description  of  production 
techniques,   (4)   a  description  of  the  field  testing,  and 
(5)  the  results  and  conclusions. 

The  situation. 

The  materials  were  developed  for  use  at  Seattle  Pacific 
University,  an  independent  institution  enrolling 
approximately  2500  students,  located  in  Seattle,  Washington • 
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Specifically,  the  simulatiors  were  developed  for  use  by 
preservice  Education  students  engaged  in  their  internship 
program.     The  content  of  the  simulations  was  focused  on 
classroom  management  techniques  for  two  reasons.     First,  it 
was  determined  that:  this  was  an  area  in  which  interns  could 
use  some  additional  training,  and  second,  I  had  access  to 
the  classroom  management  principles  which  had  been  developed 
for  Twelker's  "low  cost"  simulation  package  described 
earlier.    These  classroom  management  principles  had  beed 
developed  after  a  careful  review  of  the  literature,  and 
represented  a  thoughtfully  developed,  systematic  approach  to 
classroom  management.     I  secured  nermission  to  use  the 
earlier  content  materials  virtually  intact.    Much  saving  in 
development  time  was  thereby  attained,  as  this  content  could 
be  used  with  little  modification.     The  simulation  materials 
were  designed  to  exercise  students  in  the  use  of  the 
following  three  principles  of  classroom  management:   (1)  If 
students  are  about  to  begin  an  activity  where  rules  and 
standards  of  conduct  have  not  been  established,  the  teacher 
should  establish  such  rules  and  standards;   (2)  When  students 
vio.   ^e  the  rules  and  standards  in  ways  that  are  not 
disruptive  of  others  in  the  class,  the  teacher  should  act  in 
a  non-disruptive  manner;  and  (3)  When  students  are  violating 
the  rules  and  standarc!s  in  a  disruptive  way,  tlie  teacher 
should  act  with  enough  forcefulness  to  end  the  disruption. 
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The  University  had  acquired  several  interactive  video 
stations,  consisting  of  Apple  and  IBM  microcomputers 
connected  to  Panasonic  AG  6200  videotape  recorder/players. 
In  addition,  the  Professional  Authoring  Software  System 
(PASS)  developed  and  marketed  through  the  Bell  &  Howell 
Company  was  available  for  software  development.     The  PASS 
materials  allowed  the  development  of  branching  computer 
managed  instruction  programs,  incorpor.4i-lng  video  sequences. 

In  addition,  the  University  had  half  inch,  VHS  format 
video  recording  and  editing  equipment  available  through  its 
Instructional  Media  Center.     I  was  experienced  in  the  use  of 
this  equipment,  having  produced  a  number  of  video  programs 
for  educational  use  in  the  University.     Further,  I  had 
access  to  a  fifth  grade  classroom,  as  one  of  my  graduate 
students  volunteered  her  class  for  the  taping. 

Questions  to  be  answered 

In  developing  the  materials,  I  had  three  different 
kinds  of  objectives.    Th^  first,  and  most  important,  was  to 
determine  the  degree  to  wb"ch  the  equipment  and  software 
would  allow  the  development,  and  reliable  delivery  of 
sim^     ticns  through  an  interactive  video  format.  These 
feasibility  considerations  could  be  stated  as: 

1.     How  much  will  it  cost,  in  time  and  materials,  to 
develop  the  materials. 


ERLC 


S70 


Simulation 


44 


2.  Will  the  PASS  software  allow  the  degree  of 
flexibility  necessary  for  successful  simulations? 

3.  Will  the  interactive  video  system  be  sufficiently 
reliable  to  allow  the  materials  to  be  used  in 

an  individualized  mode? 

4.  Will  the  instructions  and  procedures  be 
clear  and  manageable  for  students  to  proceed 
independently? 

The  second  type  of  question  related  to  the  content  of 
t!^e  simulations.     If  the  hardware  and  software  systems 
worked,  would  the  students  gain  anything  of  value  from 
having  gone  through  the  simulation  training?    Because  the 
materials  which  were  developed  were  experimental,  and 
because  only  four  episodes  were  included,  the  relative 
amount  of  training  in  the  content  was  rather  limited.  How 
much  cognitive  learning  of  the  materials  could  be  expected 
from  such  materials?    Specifically,  the  relevant  questions 
included: 

1.  Will  the  students  "discover"  and  apply  the 
classroom  management  principles  as  they 
interact  with  the  situations? 

2.  Will  the  studer>^-s  be  able  to  state  the 
principles  of  classroom  management  two 
weeks  after  they  have  completed  simulation 
training? 
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The  third  and  final  question  concerned  the  question  of 
affective  student  response  to  the  simulation  training. 
Specifically,  it  was:  Do  the  students  enjoy  participating  in 
the  simulation  exercises? 

Production  of  the  materials 

Production  of  the  prototype  matr.rials  proceeded  along 
the  following  stages:  outline  of  content,  flow  chart, 
scripting,  taping,  video  editing,  CAI  authoring,  and  initial 
test. 

Outline  of  Content:  It  was  decided  that  the  materials 
would  have  two  main  sections.     In  the  first,  an  introduction 
to  classroom  simulation  project  would  be  presented  on  video 
in  the  form  of  a  mini- lecture.     Here,  the  students  would  be 
informed  about  the  general  content  of  the  package  (classroom 
management) ,  and  would  be  introduced  to  the  concept  of 
simulation  delivered  via  interactive  video. 


In  the  second  section,  the  students  would  engage  in  the 
simulation  itself  by  responding  to  four  simulated  classroom 
incidents  designed  to  give  them  practice  in  using  the 
classroom  management  principles.     First,  a  stimulus 
situation  woul<?  be  presented  via  video,  with  the  "stage 
being  set"  through  audio  overdubbing.     After  the  problem  had 
been  presented,  the  computer  would  direct  the  student  to 
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generate  a  response:  "What  would  you  do  in  this  situation?" 
After  the  student  had  responded,  the  computer  would  display 
multiple  choice  options,  asking  the  student  to  match  the 
response  they  had  made  with  one  of  the  choices.  After 
making  the  choice,  a  video  sequence  would  be  aisplayed 
showing  the  probable  student  response  to  that  choice. 
Following  the  video  sequence,  the  computer  would  deliver  a 
text  screen  interpreting  the  feedback  sequence  to  the 
student.     If  the  response  was  correct,  the  student  would 
move  on  to  the  next  episode;  if  the  response  was  incorrect, 
the  student  would  be  re-cycled  through  the  original  problem 
sequence  again.     Re-cycling  would  continue  until  the  correct 
response  was  selected.     It  is  possible  that  students  might 
go  through  any  episode  as  many  as  four  times,  as  four 
choices  of  response  were  given. 

In  the  final  section,  the  principles  would  be 
summarized  in  the  form  of  another  mini-iectura  delivered  via 
video.     In  addition,  the  studenc  was  directed  to  rewind  the 
tape,  turn  off  the  equipment,  and  prepare  the  interactive 
video  station  for  the  next  user. 

Flow  Chart;  A  flow  chart  was  developed,  illustrating 
all  of  the  branching  possibilities*  Please  refer  to  the 
flow  chart  in  the  appendix. 
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Scripting;  A  script  was  developed  for  the  introductory 
and  final  mini-lectures.    The  content  was  taken  directly 
from  the  "low  cost"  simulation  materials.    No  scripts  were 
prepared  for  the  simulation  episodes.    Rather^  general 
descriptions  of  situations  were  prepared. 

Taping;  On  the  appointed  day^  the  simulation  stimulus 
situations^  and  the  feedback  sequences  were  videotaped  in  an 
actual  fifth  grade  classroom.    The  children  did  not  memorize 
scripted  material^  rather^  the  situations  were  described  and 
they  were  asked  to  respond  "naturally"  as  if  the  situation 
had  actually  occurred.     If  anything  was  said/  they  were 
directed  to  make  responses  in  their  own  words.     I  was 
directly  involved  in  the  filming  of  Kersh's  classroom 
simulation  materials  in  the  early  sixties /  and  remembered 
that  in  that  situation,  the  approach  described  above  proved 
to  give  the  most  natural  appearing  sequences.     The  technique 
worked  '^satisf actorily  again,  most  individual  sequences  were 
taped  xn  fewer  than  five  takec,  many  requiring  only  one  or 
two. 

Video  Editing:  After  the  situations  were  taped,  the 
rini-lectures  and  the  situations  and  feedbacks  were  edited 
to  a  VHS  format  tape  which  would  be  used  in  the  interactive 
video  simulation  program.     To  minimize  tape  travel  and 
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thereby  save  time  of  video  access,  the  most  probable 
feedback  sequences  should  have  h^**n  edited  to  Imediately 
follow  the  relevant  stimulus  sitv     xon.    However,  in  the 
case  of  the  prototype  materials,  no  basis  for  judging  which 
response  would  be  most  probable  could  be  determined. 
Therefore,  the  "correct"  feedback  was  placed  immediately 
following  the  stimulus  situation. 


CAI  Authoring:  The  Bell  &  Howell  PASS  system  was 
studied  and  learned  in  sufficient  depth  to  create  the 
materials.    This  authoring  system  has  a  "prompted"  and 
"nonprompted"  versions,  the  former  being  somewhat  easier  and 
faster  to  learn.     In  the  development  of  the  materials,  it 
was  necessary  to  learn  the  procedures  of  the  "nonprompted" 
version  to  complete  the  necessary  programming.  Text 
screens,  and  branching  commands  were  developed  and  entered 
in  a  lesson  called  "CLASS." 
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Initial  Test;  After  the  CAI  and  video  materials  were 
developed,  they  were  combined  for  a  first  trial.     In  a 
dissapointing  turn  of  events,  the  system  failed  to  start  and 
stop  the  video  sequences  at  the  correct  points.  Initially, 
the  tape  had  been  edited  to  have  an  approximate  five  secjnd 
"window"  at  the  beginning  and  end  of  each  siquer.^e-     It  was 
thought  that  this  would  be  sufficient  to  correct  fox  <  rror 
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in  tape  addressing.  Unfortunately,  this  assumption  proved  to 
be  incorrect.    The  tape  was  re-edited  :o  have  a  fifteen 
second  black  segment  at  the  beginning  and  end  of  each 
sequence.     This  proved  to  allow  enough  time  for  address 
error. 

It  became  apparent  that  the  erro*    ^f  tape  addressing 
was  a  cumulative  one.     That  is,  each  error  was  added  to  the 
next,  3o  that  after  several  stops  and  starts  of  thv  tape, 
the  error  became  large  enough  to  render  the  video  unusable. 
This  was  corrected  by  having  the  video  sequences 
automaticaly  re-calibrate  themselves  after  two  episodes. 
This  procedure,  while  making  the  video  segments  more 
accurate,  had  the  disadvantage  of  creating  a  lengthy  wait 
period  for  students  while  the  calibration  process  occurred. 
In  spite  of  the  necessary  adjustments  of  the  system,  a 
satisfactory  prototype  set  of  materials  was  finally 
completed. 

Field  Test 

An  Apple/ Panasonic  interactive  video  station  was  moved 
to  my  office  so  I  could  observe,  at  close  hand,  how  the 
system  worked  as  individuals  interacted  with  the  materials. 
A  sign  up  sheet  was  prepared  with  time  slots  for  twenty 
students.     Interns  were  encouraged,  by  their  supervisor,  to 
sign  up  for  the  simulation  sessions  and  met  some  optiona] 
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course  requirements  by  doing  so.     More  than  twenty 
"volunteers"  signed  up  for  the  simulation  sessions. 

When  they  arrived^  the  materials  were  described  in 
general  terras^  then  the  students  were  directed  to  proceed. 
They  were  also  encouraged  to  ask  questions  at  any  time,  and 
to  write  comments  on  the  written  response  forms.     I  made 
myself  available  for  easy  access  to  the  students  as  they 
engaged  in  the  simulation  materials.     Their  verbal  comments 
were  recorded  for  later  analysis.    All  of  the  students 
completed  the  simulation  training. 

Results  and  Conclusions 

A  number  of  questions  were  posed  at  the  outset  of  the 
development  of  the  prototype  materials.     Results  will  be 
reported  in  terms  of  these  Questions, 

1,  How  much  will  it  cost,  in  time  and  materials,  to  develop 
the  materials. 

It  took  approximately  100  hours  to  develop  the 
materials  to  the  prototype  stage.     However,  it  should 
be  noted  that  no  time  was  required  for  content 
development  as  the  "low  cost"  materials  were  adapted  to 
the  current  project,  costs  of  developing  the  materials 
were,  of  course,  related  to  development  time.  In 
addition  to  this,  material  costs  for  tape,  diskettes, 
paper,  supplies,  etc,  was  approximately  $50,00,  For 
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those  interested  in  costs  of  hardware  and  software 
already  on  hand/  it  is  estimated  that  the  total  cost 
for  necessary  hardware  and  software ^  including  the 
video  equip.nent/  and  assuming  one  interactive  video 
station^  amounts  to  approximately  $15^000. 

2.  Will  the  PASS  software  allow  the  degree  of  flexibility 
necessary  for  successful  simulations? 

The  PASS  software  did  permit  adequate  flexibility  to 
develop  the  materials.    Limitations  were  noted  not  in 
the  CAI  software /  but  in  the  nature  of  the  interactive 
video  tape  system. 

3.  Will  the  interactive  video  system  be  sufficiently 
reliable  to  allow  the  materials  to  be  used  in  an 
individualized  mode? 

No  reliability  problems  occured  with  the  field  test. 
Th*^  equipment  operated  flawlessly. 

4.  Will  the  instructions  and  procedures  be  clear  and 
manageable  for  students  to  proceed  independently? 

Instructions  and  procedures  were  clear  enough  for  most 
of  the  students  to  fellow.     Some  minor  changes  in 
wording  were  indicated.     Few  questions  related  to  the 
instructions  or  procedures  were  noted. 

5.  Will  the  students  "discover"  and  apply  the  classroom 
management  principles  as  they  interact  with  the 
situations? 
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Preliminary  indications  were  that  students  were  able 
to  "discover"  and  apply  the  principles  on  three  of  the 
four  episodes.     In  one  case,  the  stimulus  situation 
proved  to  be  too  ambiguous  to  elicit  a  response  in  a 
a  number  of  cases.     This  is  not  a  fault  with  the 
content,  but  rather  with  the  way  in  which  the  stimulus 
situation  was  presented,  and  can  be  corrected  in 
subsequent  versions  of  the  materials. 

6.  will  the  students  be  able  to  state  the  principles  of 
classroom  management  two  weeks  after  they  have  completed 
simulation  training? 

Testing  for  knowledge  ^^f  the  principles  is  scheduled 
for  February,  1986. 

7.  Do  the  students  enjoy  participating  in  the  simulation 
exercises? 

No  formal  measures  were  taken  of  student  affect  with 
the  materials.     However,  most  of  the  students  indicated 
satisfaction  and  enjoyment  in  unsolicited  comments  as 
they  completed  the  materials. 

I  concluded  that  the  The  prototype  materials  were 
successful.     The  major  difficulty  with  the  system  was  the 
time  "wasted"  while  the  video  segments  were  located.  This 
problem  may  be  corrected  by  including  provision  in  the 
materials  for  the  student-^  to  be  doing  something, 
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responding,  reading,  etc,,  while  the  video  sequence  is 
located.     In  this  way,  these  inters uptions  in  the  flow  ot 
the  lesson  can  be  minimized. 

FUTURES 

The  main  limitation  of  the  interactive  video  system 
described  in  this  paper  relates  to  the  fact  that  the  video 
is  tape  based.     Random  access  video  disc  would  eliminate 
most,  if  not  all  or  the  problems  of  inaccurate  tape  access, 
and  tape  transport  time.     However,  at  the  present  time, 
production  of  video  discs  is  very  costly  and  not  within  the 
means  of  many  potential  local  producers,  including  myself • 
Promising  developments  in  video  disc  technology  indicate 
that  production  costs  may,  in  the  near  future,  become  low 
enough  for  local  production  of  the  type  described  in  this 
paper,  however.     In  my  opinion,  the  advent  of  low  cost  video 
disc  production  will  lead  to  significantly  improved 
interactive  based  simulation  systems. 

Perhaps  of  greater  importance  than  hardware  refinement 
will  be  the  growth  of  a  research  base  from  which  effective 
and  efficient  simulations  can  be  specified  and  designed.  In 
reviewing  the  research  literature  on  simulation  in  general, 
and  teacher  education  applications  in  particular,  I  was 
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impressed  by  the  value  derived  from  longer  term,  systematic 
resf^arch  programs,  such  as  those  conducted  by  Johns  Hopkins 
in  game  research,  and  Teaching  Research  Divsion  of  the 
Oregon  State  System  of  Higher  Education's  classroom 
simulation  research.     I  would  agree  with  Tansey  (1970)  that 
"later  workers  (in  simulation)  owe  a  debt  to  Kersh,  Twelker, 
and  Cruickshank. "  (p.  300)     This  is  not  to  deny  the  value  of 
individual  experiments,  because  they  do  provide  relevant  and 
useful  information.    However,  it  is  when  variables  are 
systematically  explored,  when  experiments  can  be  replicated, 
and  when  complex  interactions  among  treatments  and  subjects 
can  be  explored  in  repeated  studies,  that  the  much  valuable 
and  reliable  information  can  be  gained. 

With  this  sort  of  programmatic  effort  in  mind,  I  would 
propose  a  research  agenda  in  which  variables  are 
systematically  explored  as  follows.    Variable  categories, 
each  with  three  illustrative  examples  are  provided. 

Stimulus  variables 

*  Value  of  positive  vs.  negative  examples. 

*  Value  of  various  types  of  prompts  and  cues  provided 
at  various  points  in  the  simulation. 

*  "Realism"  fidelity  of  the  simulation  to  the 

underlying  cognitive  processes  being  simulated. 
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Response  variables 


Individual  vs.  group  response 


Real  time  vs.  delayed.^  contemplative  response 


Constructed  vs.  selected  responses. 


Sequencing  variables 

*  Simulations  location  within  larger  instructional 
systems :  beginning^  middle^  end. 

*  Optimal  length  of  simulation  training  related  to 
larger  instructional  system. 

*  Value  of  simulation  for  "acquisiton^ " 
"transformation^"  and  "evaluation"  phases  of  the 
learning  process. 

Content  variables 

*  Ability  of  simulations  to  facilitate  attain  cognitive 
outcomes  at  all  levels  of  the  Bloom  Taxonomy. 

*  Ability  of  simulations  to  effect  attitude  change. 

*  Relationship  of  varying  simulation  techniques  to 
varying  content  areas. 

Subject  variables 

*  Effectiveness  of  simulations  with  varying  learning 
styles  of  students. 

*  Effectiveness  of  simulations  with  varying  ability 
levels  of  students 

*  Effectiveness  of  simulations  with  students  posessing 
varying  amounts  of  background  information  in  a  given 
subject. 
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General  vari cables 

*  Effectiveness  of  simulations  used  in  connection  with 
group  vs,  individualized  instruction, 

*  Effectiveness  of  simulation  used  in  induccive  vs. 
deduct ive  instruct iona ]  sequenc ing . 

*  Effectiveness  of  simulations  used  in  connection  with 
other ^  specific  instructional  approaches. 

Variables  such  as  thoee  suggested  above,  should  be 
investigated  individually,  and  in  experiments  designed  to 
examine  interactions  among  them.    A  thoughtfully  developed 
research  agenda,  particularly  one  which  followed  a 
particular  I'iarning  and/or  instructional  theory,  conducted 
over  an  adequate  period  of  time,  would  provide  significant 
benefits  for  future  developers  of  simulation  materials. 

The  simulation  technique  ha&  shown  itself  to  be  an 
effective  training  mode,  in  seme  situations  uniquely 
valuable  in  achieving  cognitive  and  affective  outcomes. 
With  increasingly  affordable  and  sophisticated  hardware  and 
software,  this  approach  promises  to  add  much  to  our  ability 
to  develop  effective  instructional  programs.    A  systematic, 
long  term  research  effort  will  help  future  developers  to  use 
simulations  in  their  most  effective  and  efficient  manner. 
It  is  interesting  to  note  that,  in  a  recent  address  to  the 
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Harvard  Beard  of  Trustees,  President  Derek  Bok  (1985)  waxed 
eloquent  abou*:  the  potential  benefits  of  simulations  in 
promoting  "active  learning"  in  higher  education.  Simulation 
is  an  educational  technique  whose  time  has  finally  come. 
Let  us  exploit  this  valuable  instructional  technique  to  its 
greatest  that  we  may  be  of  greatest  service  to  our  students. 
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Appendix  A:  Flow  chart  of  interactive  video  prototype. 
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"NewGcact  From  the  Post":    A  Dynamic  New  TV  Series 
with  a  Global  Perspective  on  World  History 

Drew  Tiene 

Kent  State  University 

What  if  you  had  a  special  television  set  that  you 
could  turn  on  to  see  Joan  of  Arc  in  full  battle  rfegali.a 
leading  the  French  into  battle,  or  Galileo  sighting  the 
moons  of  Jupiter  in  that  new  invention  the  telescope,  or 
Martin  Luther  arguing  with  Church  authorities  about  the 
sale  of  indulgences?    Would  you  tune  in? 

Few  would  be  able  to  resist  such  an  opportunity  to 
peer  into  the  past.    The  closest  thing  to  such  a  device 
is  currently  available  to  teachers  on  the  "Newscast  From  the 
Past"  television  series.    The  Black  Death  sweeps  across 
Europe,  Gengis  Khan's  barbarians  terrorize  the  peoples  of 
Asia,  Copernicus  proposes  the  radical  idea  that  the  sun  is 
the  center  of  the  solar  system,  Hernando  Cortez  marches  upon 
the  mighty  Aztec  Empire  with  his  small  band  of  Spaniards,  and 
Mughal  emperor  Shah  Jahan  constructs  the  magnificant  Taj 
Mahal  in  memory  of  his  beloved  wife. 

Each  of  the  six  programs  encapsulates  the  events 
of  a  given  century  as  if  it  were  a  fifteen  minute  evening 
newscast.    The  telecasts  are  delivered  by  an  anchorman  and  a 
team  of  "on-the-scene"  reporters,  covering  their  stories  from 
remote  corners  of  the  world.    They  include  interviews  with 
famous  figures,  dramatic  moments  in  history  captured  on  tape. 


692 


2 


"human  interest"  stories,  debates  on  significant  issues  of 
the  time,  and  even  some  commercials  for  new  products  of  the 
day. 

While  reminiscent  of  Waiter  Cronkite's  "You  Are  There," 
the  "Newscast  From  the  Past"  differs  from  this  previous 
series  in  several  key  respects.    For  a  full  half  hour,  "You 
Are  There"  focused  upon  a  single  major  event  from  the 
relatively  recent  past,  usually  a    incident  from  American 
history.     It  approximated  the  doi  umentary  genre  more  closely 
than  it  did  the  telev  sion  news.  On  the  other  hand,  "Newscast 
From  the  Past**  more  closely  imitates  the  news  telecast 
format,  and  it  deals  with  worldwide  events  in  the  medieval 
period.    Although  its  treatment  of  specific  events  is 
more  superficial  than  the  coverage  was  on  "You  Are  There," 
the  scope  of  "Newscast"  is>  far  more  global  and  the  breadth  of 
history  that  it  encompasses  is  far  more  extensive. 

"Newscast  From  the  Past"  was  produced  at  KLRU-TV,  the 
Public  Broadcasting  Service  affiliate  in  Austin,  Texas.  It 
was  funded  by  the  Corporation  for  Public  Broadcasting  and  the 
National  Endowment  for  the  Humanities.    The  series  was 
written  by  a  team  of  scriptwriters  and  historians,  who 
carefully  monitored  its  content  for  historical  accuracy.  The 
final  scripts  were  also  mailed  to  reputable  historians  across 
the  nation  to  doublecheck  their  accuracy e    The  program's  six 
figure  budget  was  large  by  educational  television  standards, 
and  the  production  has  a  very  professional  look.    A  feature 
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film  director  was  pxaced       charge  of  the  shootingr  and  he 
successfully  orchestrated  a  set  of  convincing  performances  on 
sets  filled  with  realistically  meuieval  looking  paraphernalia. 

The  high  quality  of  this  production  was  acknowledged  by 
educators  across  the  country  during  the  so-called  "Firstview" 
sessions r  conducted  by  the  Pi  Broadcasting  Service  to 

determine  what  prograiiming  should  be  made  available  on  the 
school  instructional  television  schedule.     "Newscast  From  the 
Past"  was  voted  first  in  this  pollr  as  the  new  program  that 
most  deserved  to  be  placed  on  the  schedule.  Furthermorer 
because  it  was  produced  with  Corporation  for  Public 
Broadcasting  fundsr  "Newscast"  will  legally  be  in  tne  public 
domain  for  three  years.    This  means  that  PBS  affiliates  will 
not  have  to  pay  the  usual  fees  to  broadcast  it.  "Newscast" 
is  therefore  a  high  quality  bargain  for  local  PBS  stations, 
and  consequently  it  is  being  widely  aired  throughout  the 
country. 

Public  domain  status  also  means  that  the  programs  can  be 
videotaped  off  the  air  and  used  for  instructional  purposes 
from  now  until  the  end  of  the  1988  school  year,  without  any 
of  the  usual  copyright  restrictions.    Videotape  distribution 
of  the  series  will  be  forthcoming  in  the  near  future.  A 
forty  page  teachers'  guide  to  "Newscast"  is  available  for 
$2.25  from  KLRU~TV  in  Austin,  Texas  (see  the  address  at  the 
end  of  this  article).    Already  o\er  15,000  of  '  .lese  have  been 
distributed  to  state  education  departments  and  public 
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television  stations  throughout  the  country^  from  New  Jersey 

to  California  and  from  Alaska  to  Texas. 

Ths,  Problematic  IlatlULfi  Ot  UfiUlsI  History  Instruction 

A  survey  I  conducted  a  few  years  ago  revealed 

abysmally  low  percentages  of  high  school  students  able 

to  identify  twenty  of  the  most  influential  figures  in 

history  on  a  simple  matching  exercise.^ 

These  twenty  men  were  taken  from  a  list  that  included 

Jesus  Christ,  Sir  Isaac  Newton,  Mohammed,  Buddha, 

2 

Confucius,  Einstein,  Marx,  and  Columbus,    Why  is  it 
often  so  difficult  to  interest  adolescents  in  world  history? 
Unfortunately,  history  is  often  taught  with  an 
emphasis  upon  obscure  facts  and  figures.    Why  should 
today's  teenagers  be  expected  to  memorize  the  precise 
year  of  the  Council  of  Trent,  the  victor  of  the  Battle 
of  Tours,  or  the  site  of  the  Magna  Charta  signing? 
world  history  can  become  a  "trivial  pursuit"  when  it 
should  be  a  meaningful  one.    While  probably  more 
worthwhile,  the  conceptual  approach  to  history 
instruction  may  be  no  more  inspiring.    Lengthy  liets  of 
causes  and  results  can  remain  meaningless  abstractions 
to  pupils  unless  they  have  carefully  studied  the 
circumstances  involved. 

Ideally,  historical  study  will  move  students  through 
several  stages  of  awareness.    First  they  will  learn  what  took 
place  (perhaps  even  exploring  the  difficulties  encountered  by 
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historians  in  trying  to  establish  what  actually  did 
transpire) .    Next  they  will  assimilate  and  synthesize  this 
material,  so  that  they  can  begin  to  understand  why  events 
unfolded  as  they  did.    Then  students  should  start  to  draw 
rheir  own  conclusions  about  the  past.    Finally/  they  will 
hopefully  apply  what  they  have  learned  to  present  day 
situations.    The  lessons  that  history  has  to  offer  should 
help  young  people  develop  their  own  political  views,  and 
empower  them  to  make  thoughtful  decisions  based  upon  an 
expanded  awareness  that  ranges  far  beyond  the  limits  of  their 
own  personal  experiences.    Yet  none  of  this  personal  growth 
will  occur  if  a  student  is  not  interested  in  the  historical 
events  themselves.  Motivation  is,  therefore,  a  critical 
issue. 

What  can  excite  students  about  the  study  of  history? 
One  successful  approach  is  to  relate  fascinating  stories 
about  personalities  of  other  eras  and  faraway  cultures. 
History  can  captivate  in  the  same  way  that  literature  does, 
(and  it  possesses  the  added  allure  of  having  really 
happened) .    But  a  solid  history  course  must  also  be  more  than 
a  scholastic  "Riplei's  Believe  It  or  Not."    It  will  hopefully 
convey  some  sense  of  what  life  was  like  in  previous  times. 
Like  fine  literature,  it  should  transport  the  student  into 
other  worlds.    Teenagers  can  imagine  themselves  in  the 
stately  Roman  forum,  the  opulent  court  of  Louis  XIV,  a  clammy 
dungeon  during  the  Spanish  Inquisition,  Magellan's  weathered 
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galleotir  etc. 

For  most  high  school  history  studentsr  it  is  very 

difficult  to  accurately  picture  such  scenes r  because  the 

information  provided  by  the  textbook  is  so  limited.  In 

trying  to  survey  all  of  human  historyr  descriptions  of 

previous  eras  are  sketchy  at  best.    Some  teachers  can 

bring  certain  historical  periods  to  lifer  but  in  many 

casesr  pupils  remain  bored  with  the  subject  because 

they  cannot  relate  to  it.    Yet  these  same  students  will 

sit  for  hours  in  front  of  their  television  sets  at  home^ 

watching  Marlon  Brando  play  Mark  Anthonyr  Napoleon,  cr 

Fletcher  Christian. 

As  John  Dewey  so  often  asserted,  experience  is  a 

3 

critical  factor  in  a  young  person's  education.    Film  and 
television  have  the  capability  of  re-creating  the  past,  and 
thereby  provide  vicarious  experiences  that  involve  the 
learner.     It  is  in  this  capacity  that  "Newscast  From  the 
Past"  can  make  a  significant  contribution  to  a  world  history 
course.    To  see  how  effective  the  series  may  be  in  this 
regard,  a  survey  was  developed. 
Th&  "Newscast"  SWCVey 

How  effective  has  the  use  of  historical  drama  on  film 
(or  videotape)  proven  to  be  in  social  studies  f  iassrooms?  The 
general  instructional  efficacy  of  film  and  television  in  the 
classroom  has  been  well  documented  in  a  variety  of  research 
studies,  dating  back  many  decades.^   In  fact,  respected  media 
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researcher  William  Allen  wrote  in  the  late  1950*8,  that,  for 

factual  material,  "in  abjut  85  percent  of  the  studies 

comparing  motion  picture  teaching  with  conventional  methods, 

films  were  found  to  be  significantly  superior."^ 

The  landmark  studies  into  the  use  of  films  in  history 

classes  were  conducted  many  years  ago  by  researchers  at  Yale 

University.    A  1928  study  conducted  in  a  junior  high  school 

American  history  class  showed  a  filmed  series  of  "photoplays" 

entitled,  "The  Chronicles  of  America."^    A  rigorous 

replication  using  the  same  films  was  carried  ;out  ten  years 

later?^  Both  studies  found  significant  learning  gains  for 

students  who  viewed  the  film  series,  over  a  control  group 

that  received  conventional  instruction.     It  was  also  shown 

that  pupils  who  saw  the  films  became  mor5  interested  in  the 

subject  matter.    More  recently,  studies  on  teaching  history 

with  televised  material  have  yielded  similar  results.  One 

carefully  documented  example  was  the  favorable  set  of 

reactions  to  the  classroom  use  of  a  television  series 

8 

entitled  "American  Cultural  Heritage." 

However,  the  actual  number  of  quantitative 
investigations  conducted  on  the  effectiveness  of  using  film 
or  television  to  teach  history  is  rather  small.    As  such,  it 
seemed  appropriate  to  test  reactions  to  the  "Newscast  From 
the  Past"  programs.    A  survey  was  developed  to  examine  a 
variety  of  issues  related  to  the  instructional  potential  of 
this  series.    How  appealing  is  it  to  the  primary  target 
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audience,  high  Rchool  world  history  students?    How  easily 
might  it  be  included  in  the  typical  world  history  curriculum? 
How  effective  will  it  be  in  providing  a  more  meaningful  sense 
of  history  to  young  people? 

The  survey  was  distributed  to  363  students  from  four 
high  schools  in  the  Midwest.    While  the  student  sa.uple  was 
not  scientifically  selected,  there  was  an  effort  made  to 
obtain  a  representative  crossection  of  students  by  including 
four  distinctly  different  types  of  schools  in  the  study. 
These  sites  inc'''ided  an  upper  middle  class:  suburban  school, 
an  inner-city  magnet  school,  a  parochial  school,  and  a 
vocational  school.    Students  werf  given  a  series  of 
statements  about  the  show,  and  were  asked  to  respond  to  each 
on  a  Likert  scale.    Scores  were  averaged  for  each  item. 
Tabulated  results  are  listed  \"  the  table  of  "Survey 
Ratings. " 

Siltyfix  Eatings 

Rating  scale:    2  =  strongly  agree 

1  =  agree 

0  =  neutral, 

-1  =  disagree 

-2  =  strongly  disagree 

"Newscast  From  the  Past"  was  ntertaining. 

Seeing  historical  events  acted  out  was  interesting. 

Certain  historical  personalities  "came  to  life"  for 
me. 

The  program  did  a  good  30b  of  presenting  the  sights 
and  sounds  0*=  the  Middle  Ages. 


1.01 
1.24 

.55 

1»10 


1^ 
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The  TV  news  format  helped  make  the  historical  events 

seem  real  (as  if  they  really  happened).  .99 

History  is  more  interesting  when  presented  as  if  it 

is  current  news.  1*14 

I  was  amused  at  the  idea  of  historical  figures 

appe      ig  on  a  modern  medium  like  TV,  .99 

I  feel  that  a  series  of  programs  like  this  would  help 

make  a  mit  on  the  Middle  Ages  more  interesting.  1.34 

I  think  that  "Newscast"  programs  could  conveniently 
be  used  along  with  the  world  history  text  my 
class  is  using.  1.19 

The  program  provided  some  special  perspectives  on 
the  time  period  because  it  portrays  the  era 
differently  than  the  impression  given  in  the 
textbook.  'SS 

I  prefer  seeing  "Newscast  Prom  the  Past"  to  reading 

about  the  same  events  in  a  book.  1.22 

I  would  like  to  read  more  about  some  of  the  events 

reported  on  the  show.  '21 

The  program  provided  some  special  perspectives  on  how 
dramatically  the  world  has  changed  since  the 
Middle  Ages.  •95 

The  program  provided  some  special  perspectives  on 
how  some  aspects  of  life  on  this  planet  never 
change.  '41 

The  program  suggested  some  lessons  that  history 
has  to  offer. 

The  newscast  included  some  people  whom  I  admire  (and 

hope  to  fashion  myself  after).  -.33 

The  program  provided  some  special  perspectives  on 
what  was  simultaneously  happening  all  over  the 
world  during  a  given  period  of  history.  .70 
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Historical  QjLama  fls  &0  In&tiustifiDal  hBBLQ&&b 

Historical  fiction  has  always  been  a  popular  film 
genrer  from  Cecil  B.  DeMille's  biblical  extravaganzas  to 
present  day  television  "docudramas"  about  recent 
historical  figures  and  events.    The  "Newscast"  series  uses 
this  popular  approach  to  portray  famous  moments  and 
significant  figures  as  accurately  as  possible.    In  doing 
so,  it  hopes  to  educate  as  it  entertains.    But  the  first 
issue  is  whether  it  succeeds  as  a  dramatic  production. 

Students  agr€2d  with  the  item  "'Newscast  From  the 
Past"  was  entertaining,"  which  obtained  a  rating  of  1.01. 
In  this  age  of  bloated  budgets  and  slick  video  production 
techniques,  it  is  no  small  accomplishment  for  an  educational 
program  to  receive  such  a  positive  response  from  today's 
generation  of  adolescents,  who  are  teased,  titillated,  and 
tranguilized  by  t^^e  media  on  a  daily  basis.  An 
entertaining  program,  will,  at  least,  tend  to  hold  the 
class'  attention,  the  first  prerequisite  for  learning. 

P      getting  a  group  of  young  people  really  interested 
in  hist*  ry  is  a  difficult  challenge.    Adolescents  are 
notoriously  egocentric.    Their  concerns  extend,  at  best,  to 
an  immediate  peer  group,  but  seldom  beyond.    Asking  them  to 
consider  the  tribulations  of  another  society  several 
centuries  ago  can  be  frustrating.    Nor  do  young  people 
often  have  a  clear  sense  of  their  own  personal  history.  In 
later  adult  life,  we  can  reflect  back  upon  the  events  and 
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decisions  that  influenced  our  lives*    Such  recollections 
can  take  on  a  personal  meaning  for  us,  and  an  appreciation 
of  one's  own  "history"  develops*      et,  for  most  teenagers* 
these  perspectives  are  years  away.    Furthermore,  an 
interest  in  history  naturally  arises  among  members  of  the 
older  generation,  because  they  actually  remember  events  now 
considered  "historical."    Ycung  people  have  none  of  these 
advantages  when  it  comes  to  finding  m^?aningful  lessons  in 
the  study  of  history. 

Therefore,  it  was  extremely  encouraging  to  see  that 
students  felt  very  strongly  on  the  survey  that  "Seeing 
historical  events  acted  out  was  interesting"  (rating  of 
1.24).    This  result  alone  perhaps  should  merit  the  use  of 
"Newscast"  in  classrooms  across  the  nation.    Another  issue, 
whether  "Certain  historical  personalities  'came  to  life' 
for  me"  during  the  show,  received  moderate  support  (»55). 
In  this  caser  the  brevity  of  most  of  the  appearances  on 
camera  may  have  limited  the  impact  of  these  performances. 
Considerably  greater  support  was  given  the  statement,  "The 
program  did  a  good  job  of  presenting  the  sights  and  sounds 
of  the  Middle  Ages"  (1.10). 

If,  during  the  show,  students  experience  the 
"atmosphere"  of  medieval  tiraep,  perhaps,  ensuing 
discussions  will  be  more  meaningful  to  them.  The 
deplorable  standards  of  living^  the  vulnerability  to 
disease,  the  widespread  illiteracy,  and  other  fundamencal 
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aspects  of  Medieval  life  are  effectively  portrayed  in 
"Newscast* •    Students  can  begin  to  comprehend  how  their 
ancestors  lived,  and  then  place  the  events  and  issues  of 
that  period  in  the  proper  context • 

In  factr  perhaps  this  program  can  overcome  some  of  the 
aforementioned  problems  that  students  have  in  relating  to  a 
previous  historical  era.    It's  often  difficult  for  them  to 
imagine  what  life  was  like,  and  consequently  the  lists  of 
names  and  dates,  causes  and  effects,  winners  anu  losers, 
and  so  on,  remain  dry  abstractions.     In  viewing  the 
newscasts,  students  felt  that  "The  TV  news  format  helped 
make  the  historical  events  seem  more  real  (as  if  they 
really  happened)"  (.99).    If  "Newscast"  successfully 
communicates  the  sense  that  the  names  in  their  text  were 
living,  breathing  human  beings  who  struggled  with  the 
challenges  of  life,  just  like  the  rest  of  us,  then  it  has 
taken  its  audience  through  the  first  critical  seeps  towards 
greater  involvement.    Teenagers  can  begin  to  contemplate 
how  other  people  throughout  history  have  dealt  with  life's 
problems,  and,  in  so  doing,  may  begin  to  reflect  more 
carefully  upon  themselves,  their  own  aspirations,  their  own 
strengths,  their  own  weaknesses,  and  their  own  unique  ways  of 
dealing  with  the  world. 

Newscast  a£  an  Instriictional  £001^ 
"Newscast  From  the  Past"  takes  advantage  of  an 
instructional  format  that  young  people  have  become  accustomed 
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to  learning  from.    Many  students  in  this  study  agreed  with 

the  survey  item  "I  generally  watch  at  least  part  of  a  nightly 

news  program  several  times  a  week"  (-54).    The  potential  of 

the  television  newscast  as  an  information  source  has  been 

studied  extensively  in  the  past  few  decades.    Well  educated 

subjects  have  recalled  de^-ail  on  approximately  fifty  to  sixty 

9 

percent  of  the  items  on  a  news  telecast,    although  retention 

rates  have  been  considerably  lower  for  audiences  tested  under 

non-laboratory  conditions. Several  studies  have  shown 

that  the  visual  material  provided  on  television  news  programs 

aids  recall  of  information,^^  and  that  motion  pictures  are 

12 

more  effective  in  this  regard  than  stills.        Viewers  general 

overall  knowledge  of  current  events  has  been  positively 

correlated  with  their  ability  to  recall  specific  facts 

13 

included  in  a  telecast,      and  those  that  watch  newscasts  in 

order  "to  become  informed"  recall  significantly  more  than 

.  14 

those  who  watch  "casually"  or  "to  relax." 

These  findings  suggest  that  a  newscast  style  program  has 
instructional  potential  in  the  classroom.    Learning  gains 
from  news  broadcasts  have  been  rather  significant  under 
"supervised"  conditions  and  classroom  viewing  is  certainly 
supervised.    Furthermore,  "informed"  viewers  demonstrate 
higher  learning  gains  than  uninformed  viewers,  and  attentive 
students  in  the  middle  of  a  history  course  would  hopefully 
already  be  somewhat  knowledgeable  about  the  material  from 
their  readings  and  discussions. 
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Student  reactions  to  the  use  of  a  news  telecast  format 
to  depict  events  in  world  history  were  obtained  on  an  number 
of  survey  items.    The  statement  "History  is  more  interesting 
when  presented  as  if  it  is  current  news"  attained  a  strong 
rating  of  1.14.    Is  it  the  inherent  appeal  of  the  evening 
news  format r  with  its  fast  paced  mix  of  film  footage  and 
commentary  that  involves  the  student  audience?    This  could 
not  be  the  sole  explanation,  for  the  statement  "I  normally 
enjoy  watching  nightly  news  programs  on  TV"  rated  only  a  .32 
level  of  agreement. 

PerhapSf  more  significant  is  the  novel  twist  that  the 
"Newscast  From  the  Past"  series  gives  to  this  standard 
television  format.    The  survey  statement  "I  was  amused  at 
the  idea  of  historical  figure©  appearing  on  a  modern  medium 
like  TV"  received  a  rating  of  .99.    Repeated  observation  of 
groups  watching  the  show  for  the  first  time  confirms  this 
"novelty"  factor r  for  the  majority  of  faces  in  the  audience 
invariably  become  animated  as  an  historical  figure  is 
interviewed  by  a  reporter. 

Why  should  "Newscast  From  the  Past"  elicit  such  a 
pleasantly  startled  response  from  its  audience?    After  allr 
people  have  long  become  accustomed  to  watching  historical 
drama  on  television.    It  may  be  that  the  presence  of  modern 
telecommunications  equipment  in  the  "Newscast"  scenes 
contributes  to  this  phenomenon.    Microphones  are  thrust  at 
medieval  personalities r  creating  an  incongruity  that 
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probably  intrigues  the  audience*    This  "reverse 
anachronism"  upsets  our  established  conceptions  of 
historical  reality*     It  has  the  same  absurd  effect  as  the 
"what's  wrong  with  this  picture"  cartoons  we  enjoyed  as 
children,  in  which  one  object  does  not  belong  in  the 
situation* 

These  modern  devices  also  suggest  one  of  the  most 
tantalizing  fantasies  of  the  present  century:    time  travel. 
From  the  publication  of  H.  G*  Well's  classic  novelette  lilft 
liffifi  Machine  to  the  release  of  Steven  Spielberg's  current 
hit  film  "Back  to  the  Future,",  the  concept  of  time  travel 
has  increasingly  come  to  captivate  the  public  imagination. 
"Newscast  From  the  Past"  implies  an  accessibility  to  the 
intriguing  events  of  the  past  via  modern  technology,  a 
magic  camera  through  which  we  can  peer  into  past  eras. 
This  idea  undoubtedly  has  considerable  appeal. 

Why  else  might  history  seem  more  interesting  when 
presented  as  if  it  is  current  news?    Naturally,  people 
will  tend  to  be  more  interested  in  today's  events  than  those 
of  the  distant  past  because  they  are  more  likely  to  be 
affected  by  them.    The  public  can  become  conditioned  by  media 
formats  to  react  in  certain  ways,  and  they  generally  respond 
to  newscasts  with  concern.     In  us'ng  this  format,  a  "Newscast 
From  the  Past"  may  benefit  from  some  of  this  mental 
conditioning.    Through  the  reports  of  a  news  anchorman,  the 
events  of  the  past  seem  more  immediate  and  compelling. 
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In  addition,  the  newscast  format  may  create  a 
context  that  seems  more  "real"  to  the  viewer  than  the 
average  docudrama.    While  film  narrative  has  traditionally 
been  fictional,  newscasts  have  always  presented  real 
incidents.    The  events  portrayed  on  the  "Newscast"  programs 
may  derive  a  certain  degree  of  subconscious  credibility 
from  the  fact  that  they  are  reported  using  all  the  normal 
conventions  of  a  news  program.    This  conjecture  is 
supported  by  the  strong  agreement,  mentioned  earlier,  with 
the  statement,  "The  TV  news  format  helped  make  the 
historical  events  seem  more  real  (as  if  they  really 
happened) . " 

"♦Newscast"  th&  History  Curriculum 

Would  the  "Newscast  From  the  Past"  series  enhance  a  high 
school  world  history  curriculum?    The  survey  item  ••I  feel 
that  a  series  of  programs  like  this  would  help  make  a  unit  on 
the  Middle  Ages  more  interesting"  received  a  rating  of  1.34, 
the  highest  score  on  the  entire  survey.    High  school  history 
students  ^'Ould  very  much  like  to  see  this  series  included  as 
part  of  their  coursework. 

But  did  they  feel  that  the  programs  could  effectively 
compliment  the  material  in  their  texts?    There  was  clear 
agreement  (1.19)  with  the  statement  "I  think  that  "Newscast* 
programs  could  conveniently  be  used  along  with  the  world 
history  text  my  class  is  using."    Five  teachers  surveyed  on 
these  two  items  also  agreed  with  them  (average  rating  of  1.00 
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on  both  this  items  and  the  previous  one)  . 

The  "Newscast"  series  can  be  used  in  a  variety  of 
interesting  ways  in  world  history  classes.    But  these 
programs  would  probably  be  best  employed  as  an 
introduction  to  the  study       various  medieval  centuries. 
They  provide  a  stimulating  overview  with  which  to  begin 
discussion.     Since  the  newscasts  furnish  a  visual  sense  of 
the  times r  they  probably  should  be  shown  before  students 
are  asked  to  engage  in  more  abstract  activity,  like  reading 
or  discussion.    Then,  hopefully,  this  verbal  material  will 
be  grounded  in  some  concrete  perceptions  of  what  was 
happening  at  that  time. 

In  factr  without  adequate  exposure  to  visuals 
characteristic  of  the  period/  students  may  have  difficulty 
forming  accurate  impressions  of  what  the  Middle  Ages  were 
like.    This  problem  may  be  especially  severe  for  poor 
readersr  who  have  trouble  understanding  the  text.     It  was 
interesting  that  a  reasonably  large  percentage  of  students 
agreed  with  the  survey  item  "The  program  provided  some 
special  perspectives  on  the  time  period  because  it  portrays 
the  era  differently  than  the  impression  given  in  'che 
textbook"  (.55).     One  has  to  wonder  what  some  of  these  pupils 
imagined  about  the  medieval  era  before  they  viewed  the 
show. 

The  need  for  visual  material  in  history  units  is 
underscored  by  the  strong  student  support  (1.22)  for  the 
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survey  item  "I  prefer  seeing  'Newscast  From  the  Past'  to 

reading  about  the  same  events  in  a  book*,"    The  television 

programs  co.nmunicate  the  events  of  the  Middle  Ages  in  a  more 

dynamic  way  than  a  textbook  can  ever  hope  to.     It  was  felt 

that  the  interest  generated  by  the  "Newscast"  shows  might 

stimulate  further  reading  on  medieval  topics.    However ,  only 

some  students  indicated  that  "I  would  like  to  read  more  about 

some  of  the  events  reported  on  the  show"  (.21). 

Conceptual  Learning  Izsm  thSi  "McWSCast" 

In  addition  to  relating  interesting  facts  and  providing 

a  feeling  for  the  times,  a  reallv  dynamic  television  program 

about  history  will  deal  with  imp.  i.tant  concepts.     Items  were 

included  in  the  survey  to  explore  how  students  perceived 

their  own  conceptualizing  about  history  as  they  watched  the 

newscasts.    While  these  responses  are  not  actual  measures  of 

learning r  studies  have  shown  that  perceptions  about  how 

worthwhile  a  program  has  been  do  correlate  postively  with 

15 

actual  later  achievement  gains. 

There  was  general  agreement  {•95)  that  "The  program 
provided  some  special  perspectives  on  how  dramatically  the 
world  has  changed  since  the  Middle  Ages."    The  series  seems 
to  effectively  portray  how  the  social,  economic,  and 
political  circumstances  of  the  medieval  period  differed  from 
the  present  situation. 

Some  students  also  felt  that  "The  program  provided  some 
special  perspectives  on  how  some  aspects  of  life  on  this 


709 


19 


planet  never  change"  (•41).  There  are  attempts  within 
"Newscast"  episodes  implying  that  certain  historical  themes 
persist  through  the  ages.  For  e:;ampler  the  sixteenth  century 
newscast  describes  a  jungle  war  in  Vietnam  and  the 
seventeenth  century  program  reports  on  the  violence  in 
Northern  Ireland  between  Protestants  and  Catholics. 

There  was  also  some  support  (•48)  for  the  statement  "The 
program  suggested  some  lessons  that  history  has  to  offer r" 
despite  the  fact  that  these  surveys  were  filled  out  by  groups 
that  had  not  discussed  the  program.    With  appropriate  teacher 
follow-upr  the  responses  to  this  item  would  probably  be  even 
more  positive. 

Admittedly  these  questions  only  superficially  explore 
the  issue  of  how  conceptually  stimulating  the  "Newscast" 
series  may  be.    More  specific  examination  of  what  pupils  are 
really  learning  from  the  series  would  serve  as  a  worthwhile 
research  endeavor  especially  given  the  paucity  of  data 
presently  available  to  history  teachers  on  the  instructional 
effectiveness  of  history  drama.    Nevertheless r  these 
positive  survey  responses    on  crucial  pedagogical  issues 
remains  encouraging. 

However r  not  so  encouraging  was  the  negative  pupil 
reaction  (-.33)  to  the  statementr  "The  newscast  included  some 
people  whom  I  admire  (and  hope  to  fashion  myself  after)." 
Apparentlyr  the  heroes  of  the  Middle  Ages  are  truly  difficult 
for  modern  day  adolescents  to  identify  with.    Perhaps  they 
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are  not  portrayed  in  an  attractive  enough  light.  For 
whatever  the  reason,  "Newscast"  failed  to  inspire  its 
audience  in  this  regard. 

But  in  another  important  respect,  "Newscast"  succeeded 
rather  admirably.    It  was  designed  to  present  the  major 
events  happening  simultaneously  all  over  the  world,  a  kind 
of  horizontal  dice  of  history.    There  is  a  need  for  this 
approach  in  most  world  history  curricula,  which  proceed 
chronologically  for  lengthy  periods  within  a  given  region  and 
later  double  back  to  cover  the  same  time  frame  in  another 
part  of  the  world.    Therefore,  it  is  difficult  for  a 
student  to  sense  what  was  actually  occuring  at  the  same 
time  in  medieval  Europe,  Kublai  Khan's  China,  the  Indian 
empires  of  Latin  America,  the  kingdoms  of  western  Africa, 
the  Islamic  world,  and  so  on.     "Newscast"  could  fulfill 
this  vital  function  in  world  history  classrooms,  and,  in  fact, 
students  agreed  that  "The  program  provided  some  special 
perspectives  on  what  was  simultaneously  happening  all  over 
the  world  during  a  given  period  of  history"  (.70). 

This  global  perspective  is  an  especially  valuable 
aspect  of  the  "Newscast"  series.     It  indicates  the 
increasing  degree  of  contact  which  developed  between  different 
civilizations,  over  the  centuries,  elucidating  the  effects 
which  cultures  on  different  continents  may  have  had 
upon  one  another.     "Newscast"  can  contribute  to  a  greater 
understanding  of  historically  significant  global  trends. 
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such  as  the  spread  of  major  religions,  the  rise  of  European 
imperialism,  the  development  of  multi-national  business 
enterprises,  the  first  stirrings  of  democracy  as  an 
internationally  significant  political  movement,  the  evolution 
of  well  established  global  trading  patterns,  etc.    The  scries 
can  help  establish  the  larger  overall  picture,  and  then  the 
teacher  and  the  text  can  proceed  to  fill  in  the  details. 

"Newscast  From  the  Past"  was  greeted  with  considerable 
enthusiasm  in  the  history  classrooms  I  surveyed.     Its  use 
of  a  television  news  format  helps  bring  history  to  life  in 
ways  the  lecture  or  text  cannot.     It  conveys  a  number  of 
significant  historical  concepts,  and  provides  a  truly 
global  perspective  on  the  major  trends  in  a  given  century. 
The  "Newscast  From  the  Past"  series  should  be  an  exciting 
addition  to  world  history  classrooms  across  the  nation. 
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Usin<j  Television  to  Develop  "The  High  School  of  the  Future" 

Drew  Tiene 
Kent  State  University 
The  transformation  of  our  schools  into  institutions  r.iore 
rei^pon&ive  to  the  needs  of  today's  youth  is  an  urgent 
chall^^nge,  fraught  with  innunierable  difficulties.     Such  a 
formidable  task  requires  resourceful  apnroaches  and  ingenious 
solutions.    One  such  project^  "The  Coalition  for  the  High 
School  of  the  Future"  in  northeast  Ohio#  decided  to  produce  a 
low  budget  videotape  to  generate  interest  in  its  proi>osals 
for  educational  refori.t.    This  television  show  eventually 
oroved  highly  .'u?cessful  in  communi eating  the  purpose  of  the 
project  in  dynamic  fashion.    This  article  will  discuss  how  a 
considerable  degree  of  interest  in  the  coalition  was  aroused 
by  this  video,  and  will  include  the  results  of  a  survey  that 
later  docunented  specific  ways  in  which  the  video  helped 
establish  a  Momentun  that  has  propelled  the  Kich  School  cf 
the  Future  project  into  its  second  year. 

This  coalition  consists  of  five  high  schools  and  four 
universities  i^»  the  Cleveland-Akron  area.     It  also  eventually 
hopes  to  include  local  coMiounity  grouris  and  businesses.  The 
project  hopes  to  revitalize  the  learning  experiences  offered  at 
these  five  high  schools.    These  "model"  sites  differ 
considerably  froiP  one  another.    They  include  a  nearly  all 
black  inner  city  school #  a  virtually  all  white  rural  school, 
an  affluent  white  suburban  school,  an  urban  "T;>agnet"  school, 
and  a  school  with  a  racial  mix  that  includes  whites,  blacks, 
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and  Hispanics, 

Like  other  school  reform  projects  of  its  kind  that  have 
arisen  throughout  the  country  in  the  past  fev^  years,  this 
coalition  has  sought  to  facilitate  change  by  encouraging 
schoo]  f>taff  ruerobers  to  initiate  their  ov;n  plans  for 
improving  educational  standards  (McCormack-Larkin,  1 985; 
!!illerr  Cohen,  &  Sayre,  1985).     3ach  school  established 
faculty  committees  to  re-exardne  its  educational  priorities. 
A  formal  proposal  for  improving  the  instructional  climate 
v/ithin  the  building  would  be  dr^^wn  up,  with  the  emphasis 
placed  upon  the  developing  of  more  effective  methods  of 
pj-eparing  young  people  for  living  in  our  rapidly  changing 
society. 

V7hile  each  school  would  be  encouraged  to  develop 
appropriate  strategies  for  : cs  own  unioue  oircunstances,  the 
coalition  leaders  offered  5?or>e  suggf^stions  for  reform  based 
upon  recent  re-^earch  on  the  state  of  the  American  public  high 
school  (Boyerr  1983;  Goodladr  1984;  Sizer,  3984). 
Curriculum  revision  whould  be  initiated  by  the  teachers 
themselves.     An  emphasis  .pon  connunications  skills  would  be 
stroncjlv  advised.    An  expanded  teacher  contract  plan  might  be 
considered,  to  improve  salaries  and  to  engage  teachers  in 
professional  activities:  through  the  summer.    Team  teaching 
efforts  would  be  encouragedf  to  reduce  some  of  the  isolation 
of  the  job  and  to  stimulate  an  exchange  of  ideas.  Career 
ladders  would  be  considered,  so  teachers  could  advance 
professionally  to  positions  of  instructional  leadership. 
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Administrators  would  becor.^e  active  facilitators  of  positive 
chanye#  rathf^r  than  yuardians  of  the  status  nuo.     Final  ly^ 
dynardc  new  technologies  for  developing  instruction  would  be 
ricuuired  and  effectively  ennloyed,     Tn  the  spring  of  1984, 
the  coalition's  leadership  dp] iberated  as  to  how  they  could 
;»ost  effectively  present  these  recopnnendations  to  prospective 
participants.    The  possibility  of  producing  a  "video 
proposal"  arose,  and  it  seemed  a  dynamic  way  to  communicate 
ideas/  to  nuhljcize  the  project,  and  to  motivate 
participants. 

The  f(lvf<ntane  of  ^  "Vid^o  Proposal " 


The  objectives  of  the  High  School  of  the  Future  Project 
were  both  ai'bitious  and  ambiguous.     The  project  needed  an 
identity,  in  a  sense,  and  a  carefully  conceived  video  could 
help  give  it  one.     The  television  nedium  can  deliver  material 
in  very  realistic  and  uecmingf ul  ways  (Comstock,  1980).  Its 
visual  component  adds  a  communication  dimension  that 
trrcinscends  what  a  public  speaker  can  convey.     In  identifying 
problems  to  be  redressed,  actual  examples  can  be  shown.  In 
recommenrling  solutions,  the  possibilities  can  be  staged  and 
taped.     Participating  personnel  can  appear  in  the  context  of 
their  own  institutions  so  the  viewer  actually  sees  who  is 
involved  and  where  this  project  will  be  conducted.    A  tape 
can  provide  a  "visual  survey"  of  the  project,  so  interested 
parties  can  judge  its  potential  merits  for  themselves. 

The  coalition  wanted  to  involve  as  many  people  as 
possible,  who  were  associated  with  each  of  the  five  sites. 
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Its  lea(3ershii>  Cfit  strongly  that  high  schools  could  only  be 
iin[)rovecl  if  all  concerned  parties  worked  together  for  change 
(Hall  et  al.r  1984;  Pincus  &  WilliaiTis,  1979),     This  tean 
woolfl  include  teachers,  adroinistrators,  students,  university 
professors,  parents,  and  members  of  the  corninuni ties 
surrounding  aech  high  school.    To  attract  the  support  they 
neederl,  project  leaders  felt  a  videotape  would  be  ideal. 
Television  can  be  a  powerfully  Motivating  medium 
(Frank      Greenberg,  1980j  Pearl,  1982).    Sequences  can  be 
carefully  planned  to  portray  the  project  in  an  extrer««ely 
positive  light.     !lusic  can  subtly  manipulate  the  emotions.  A 
charisnatic  sounding  narrator  can  he  quite  convincing. 
Because  the  success  of  the  project  depended  so  heavily  upon 
establishing  a  broad  base  of  support  in  its  early  stages,  it 
v/as  felt  a  pe  ive  videotape  should  be  produced,  despite 

the  tirue  and  expense  that  might  be  involved. 

Sone  practical  considerations  also  led  the  coalition's 
leadership  to  conirdssion  the  tape.     In  the  effort  to  enlist 
support  for  the  project,  many  meetings  would  be  held.  A 
rnedie  r)roduction  is  ideal  for  nultiple  presentations.  A 
videotape  woulr!  save  project  spokesmen  frorj  having  to 
repeatedly  explain  their  goals  at  meeting  after  meeting.  It 
vjoujd  also  "standardize"  the  presentation  so  that  all  groups 
received  the  sarne  information  about  the  project,  preventing 
possible  rasconceptions  and  miscommnnication  later  on.  In 
addition,  the  program  would  serve  as  a  focal  point  for 
discussion  between  interested  parties  about  the  project 
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providing  a  "common  ground"  around  which  issues  could  be 
debated  and  de]iheratpd. 

The  geographically  dispersed  nature  of  the  project  sites 
presented  another  problem  for  the  coalition.    The  five 
scnoolf;  were  scattered  across  an  area  of  Ohio  rr«nging  fron* 
the  ghettos  of  Cleveland  to  the  rollina  farr,iland  east  of 
Akroo/  a  distance  of  approximately  fifty  iniles.    Travel  tiwe 
between  sites  could  become  both  time  consuming  and  expensive. 
Once  acain,  distribution  of  tapes  could  eliminate  some  of 
this  difficulty. 

This  particular  collection  of  five  hich  schools  was  in 
nany  ways  a  ipicrocosm  of  the  nation's  schools  as  a  whole.  -^--^ 


int-O  uodel  "High  Schools  of  the  Future''  the  ar^plicability  of 
their  cumulative  experiences  would  be  considerable  indeed. 
However/  if  it  ever  hoped  to  become  a  viabTp,  cohesive  entity 
that  drew  strength  from  its  diversity,  the  coalition  would 
need  to  involve  the  various  sites  with  one  another.     Up  to 
this  point/  these  five  schools  had  very  little  contact  with 
one  another.    A  videotape  seemed  ideal  for  showing  audiences 
throughout  thp  project  what  each  of  the  sites  was  like.  It 
could  help  begin  the  process  of  establishing  a  network 
between  schools  byr  in  a  senser  visually  introducing  them  to 
one  ariother . 

Th'^  videotape  also  had  the  potential  to  introduce  key 


these  particular  schools  could  successfully  evolve 
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participants.     Interview  footage  with  school  principals  anrl 
Jdcjhly  respected  teachers  ndoht  influence  faculty  i^embers  at 
each  school.    There  is  considerable  evidence  to  indicate  that 
the  support  of  opinion  leaders  is  critical  to  the  success  of 
an  institutional  chanye  project  (Rogers^  1583)  •     In  this  case, 
key  figures  would  be  identified  and  then  asked  to  voice  their 
enthusiasm  for  the  inoject  on  tape.    Their  nost  appropriate 
remarks  would  then  be  edited  into  the  progreiri  at  various 
points  throughout  the  show.     In  this  way#  perhaps  the  tape 
could/  to  some  degree,  shortcircuit  the  lengthy  interpersonal 
persuasion  process  generally  involved  in  the  adoption  of 
innovative  ideas  (Mancuso,  1969).     As  it  turned  out,  the 
videotape  production  teari  was  fortunate  enough  to  obtain 
interview  footage  with  John  Goodlad,  a  nationally  recognized 
leader  in  the  high  school  reforn  movement.  Goodlad's 
presence  on  the  tape  lent  the  whole  project  some  valuable 
credibi] ity . 

In  the  spring  of  1984,  it  appeared  a  "video  proposal" 
r.ught  serve  as  an  effective  nieans  of  clarifying  project  goals 
and  generating  son^e  initial  enthusiasn^.     Consequently,  a  ^ean 
of  faculty  T.^enbers  and  graduate  students  in  the  educational 
technology  departrnent  of  'fent  State  University's  College  of 
Education  proceedt-u  to  produce  the  progran.     Production  went 
on  for  several  months,  with  the  vast  majority  of  costs 
consisting  of  in-house  expenses.     Kent  State  University 
possessed  all  the  equipment  necessary  to  produce  the  tape. 
The  faculty  members  involvecl  were  already  on  salary  and  the 
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students  worked  on  the  tape  an  part  of  their  assistantshix^s . 

July  of  3984,  a  seventeen  ninute  proyran*  entitled  ''The  Hitjh 

School  of  the  Future"  was  ready  for  viewimj  and  was  shown  to 

potential  funding  agencies.     That  Septernber,  it  was 

ujsspMinated  to  all  five  schools,  wherf  it  was  shown  on 

repeate*!  occasionsm  including  teacher    >HHt-ircjs,  parent 

n»eetings/  studenc  assemblies,  and  workshoi^s.     Hov  successful 

was  this  program  in  achieving  its  objectives? 

Survey  Findinns:     How  Successful  was  the  Taoe? 

A  survey  was  distributed  to  each  of  the  five  schools  in 

the  coalition.     It  was  completed  by  the  rrier.«bers  of  ^a  h 

school's  leadership  team,  a  group  of  teachers  selected  by 

their  fellow  faculty  'oembers  to  write  a  proposal  for  changing 

aspects  of  their  school.    The  fifty-seven  responses  indicated 

sone  definite  opinions  about  the  inpact  of  tiie  television 

prograp  on  the  project  in  its  early  stages. 

"Hioh  School  pf  the  Future"  Vltleo  Survey  Results 

+2  =  strongly  agree 

-^1  =  agree 
0  =  neutral 

-1  =  disagree 

-2  =  strongly  disagree 

Raiting  Survey  Item 

le26      ?he  videotape  hr»s  helped  make  people  aware  of  the 

project,  who  otherwise  would  not  know  of  its  existence. 

.93      The  tape  effectively  informs  people  about  the  nature 
of  the  project. 

.57      I  feel  the  tape  helps  clarify  certain  aspects  of  the 
project's  "mission"  which  rnight  otherwise  have 
remained  ambiguous  or  misunderstood. 

1.25      The  show  conveyed  the  impression  tha^  iinproving  our 
high  schools  is  an  important  undertaking. 

o 
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l.?3      The  sliow  nortrr.yetl  tli^-  Hi^jh  School  of  tl»e  Future 
project  in  a  very  positive  light. 

-1.32     An  audiotani?  of  the  narration  would  have  been  almost 

as  effective  as  the  videotape  in  conveyincj  information 
about  the  project. 

1.24      Visuals  Made  the  narrative  material  ^r^orf-  i ntprestin<j . 

78      CoFrtH'ftnts  on  tcipe  V^y  project  particix^ants  were 

especially  convincinn  because  they  should  understand 
the  situation  at  their  own  schools. 

.93      These  remarks  by  involved  staff  helped  establish  the 
impression  that  some  changes  in  public  high  schools 
are  necessary. 

.96      The  interview  footage  with  staff  fron  each  school 

helped  convey  a  sens^  oF  007.1,0  tf  ent  on  the  part  of  all 
five  schools. 

.93      The  tape  made  me  feel  my  school  is  part  of  soi teething 

larger,  which  extends  across  this  part  of  the  state. 

The  scenes  of  the  U.S.  space  progran  suggested: 
1.30      the  future 
1.20  technology 
1.12  achievement 

.80      the  fror.tier 

.54  patriotis:" 

t-7hat  do  these  survey  resiilts  indicate  about  thp  power  of 
video  to  publicize?     It  turned  out  that  there  was,   in  fact, 
considerable  agreerr.ent  with  the  statement  that  "The  videotape 
baf;  helped  make  people  aware  oT  the  project,  who  otherwise 
would  not  know  of  its  existence"  (rating  of  1.26).     On  OT)en- 
ended  parts  of  the  survey,  project  participants  were  free  to 
elaborate,  and  the  following  staternents  were  recorded. 

"The  tape  was  used  effectively  in  worksl^ops  to  introduce 

the  public  to  the  project." 

"At  the  first  workshop  where  the  tape  was  shown,  a  high 
decree  of  interest  was  sparked  and  continu^^s  now." 
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"VJe  have  bar!  positive  involvement  from  representatives 
of  novercil  nronos,  after  they  revieweJ  tlur  tape," 
Thus,  there  wa.s  j=;troncj  evidence  thnt  a  primary  objectives  of 
the  tape  was  acconpl  i  f-hed;  to  expand  awareness  about  the 
project  in  hopes  of  invoJvino  l<^r»je  :mnhers  of  pa rt ici;»aats 
j  n  the  coal j  tion. 

Did  the  FMedium  of  television  provide  a  clear  statement 
of  goals  that  effectively  articulated  its  purposes?  It 
appears  to  have  been  generally  successful  in  this  regard 
also,     A  average  score  of  .93  was  recorded  for  the  statement/ 
"Tlie  tape  ^effectively  inforns  people  about  the  nature  of  the 
prciect."    A  .57  v.-^s  received  in  response  to  the  iten^,  "I 
feel  the  tape  helps  clarify  certain  aspects  of  the  project's 
mission  which  might  otherwise  have  remained  anbigious  or 
misunderstood."    A  lower  score  on  this  last  item  was  not 
suri>r  i  si  n<j.    T'^e  ^joals  of  the  project  were  deliberately 
stated  in  general  terms,  so  that  individual  schools  could 
interpr^^t  thpn  as  they  saw  fit.     Several  anecdotal  responses 
indicated  that  the  program  provided  teachers  with  a  cogent 
summary  of  wha^  the  project  hoped  to  accor«plish  and  even 
implied  that  the  show  may  have  served  to  solidify  the 
coal ition. 

"It  shows  the  whole  program. .. its  was  crisp,  clear,  and 
to  the  point . " 

"The  coalition  concept  was  conveyed  well." 

"The  scope  of  the  project  seemed  so  vast  to  me*  I 

needed  a  'cohesive  device*   (the  tape)  to  bring  my 
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f ra'ji'iented  i<1eaR  an<l  expectations  together." 

Did  the  videotape  effectively  arcjue  the  necessity  for 
channe,  in  its  efforts  to  motivate  participants?  The 
statement  "The  show  conveyed  the  impression  that  improvintj 
our  hjch  sciioolf  \p  an  important  undertaking"  received 
considerable  support  (1.25  rating).    Convincing  i»articipants 
toHt  thifi  particular  project  could  be  a  viable  approach  to 
irnproviny  the  system  was  also  critical.     The  item  "The  show 
iiortrayed  the  Hi'jh  School  for  the  Future  project  in  a  very 
'oositivp  linh:"  was  rated  at  1.23.     The  video  was  clearly 
succesf^fnl   in  ^^^or trcay ing  the  project  as  a  meaningful  one, 
with  good  rntentions,    Sorae  survey  comLients  on  this  issue 
were: 

"The  tape  effectively  conveyed  the  desperate  neer?  for 
change,  " 

"It  hao  appeal  Cor  all  who  are  concerned  with  the  future 
of  education. " 

Thus;  s\irvey  responses  supported  the  inforina]  feedback 
initially  received  that  "The  High  School  of  the  Future"  tape 
^successfully  contributed  to  publicizing  the  project, 
comipuricat inn  its  basic  goals,  and  building  support  for  it. 
But  how  was  it  able  to  do  so?    V7hat  specific  capabilities  of 
video  contributed  to  this  success?    What  production 
approaches  were  used  to  accomplish  the  tape's  objectives? 
How  can  educators  interested  in  developing  similar  tapes  for 
their  own  projects  achieve  similar  results? 
rf f ftct ivelv  presenting  Jnnovat ive  Jdeas  yhrounh  V^deo 
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Many  items  on  the  survey  (lec«lt  with  production  issues. 
One  strength  of  the  television  nediuir  is,  of  course,  its 
ability  to  present  dynanoc  visuals.    The  strength        a  vifleo 
wrf*sentat i on  at  meetings,  in  coFiparison  with  a  public 
Hofjfess,  lies  prin^arily  in  its  ability  to  provide  this  visua^ 
matprial.     To  test  the  si^jnii  icance  of  this  visual  coinuonent, 
several   relevant  questions  were  included  in  the  survey.  One 
hypothesised,  "An  audiotape  of  the  narration  would  have  been 
aJpost  as  effective  as  the  videotai>e  in  conveying  inforroation 
about  the  project."    This  statement  was  strongly  disagreed 
with  (-1.12).     The  iter»  "The  visuals  made  the  narrative 
material  more  interesting"  was,  on  the  other  hand,  strongly 
agreed  with  (1.24).    Viewers  also  ^^greeJ  witij  the  statep'ent 
"The  visuals  included  in  the  program  enhanced  the  sh^w  by 
providing  specific  instances  of  wliat  the  narrator  was 
discussing"  (.95).    Apparently,  the  visual  aspects  of  the 
show  were  absolutely  critical  to  its  success.    These  results 
help  explain  the  enthusiasm  expressed  by  coalition  leaders 
over  the  tape's  effectiveness  as  an  opener  at  meetings  about 
the  project.     Several  written  comments  alluded  to  the 
significance  of  the  role  played  by  visuals  in  comji unicatino 
to  coalition  members  what  the  project  was  all  about: 

"A  good  visual  overview  of  the  project." 

"It  showed  the  diversity  of  schools  involved." 

"It  is  easier  to  convey  the  general  aims  of  the  project 

through  visuals. " 

As  mentioned,  there  was  a  considerable  amount  of 
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interview  footarje  inclucle<l  in  "The  Hiyh  School  of  the 
Future. "    Coalition  leaders,  includiny  botli  adndnist rat orr> 
and  teachers,  expressed  their  aspirations  for  the  orojeci. 
Editing  allowed  tiie  producer  to  select  the  nost  articulately 
expressed  cornn^ents  and  to  insert  them  into  tne  show  at 
appropriate  Pio:nents.    The  result  wat*  oThen  a  T'.'eaninijLUI 
"testinonial"  for  the  project,  which  gave  c^n  iinpretiyion  of 
commitment,  unity,  purposeful ness,  and  optimism. 

The  questionnaire  sought  to  verify  whether,  in  fact,  the 
intended  image  caTr^e  across.    General  agree:»ent  was  recorded 
in  reaction  to  the  following  statenients;     "The  comments  on 
tape  by  project  participants  were  especicMy  convincing 
because  they  should  understand  the  situations  at  their  own 
schools"  (.78),  "These  remarks  by  involved  staff  helped 
establish  the  impression  that  sone  changes  in  public  high 
schools  are  necessary"  (.93),  "The  interview  footage  with 
staff  fropj  each  school  helped  convey  a  sense  of  commitment  on 
the  part  of  all  five  schools"  (.96),  and    The  tape  made  me 
feel  my  school  is  part  of  something  lo.rger,  which  extends 
all  across  this  part  of  the  state"  (.93). 

It  appears  that  videotape  can  effer^tively  present  ti»e 
supx^ort  of  key  opin-'on  leaders,  something  that  has  been 
considered  critical  to  the  success  of  any  institutional 
change  project.     Normally,  these  kinds  of  endorsements  would 
be  delivered  around  the  school  building  over  a  period  of 
weeks,  or  even  months.    Videotape  streamlines  this  process, 
so  that  large  groups  can  be  immediately  exposed  to  these 
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statements  of  r.uppcrt.      This  video  anproacb  un^  tlierpby 
beln  accelerate  the  chancje  [>rocess. 

Possibly  the  n^ost  interesting  finiling  on  tbe  entire 
survey  wa^  that  viewers  were  definitely  affected  by  a  "visual 
netaphor"  included  in  the  ^how.     To  sunnest  hnp  future,  ^  one 
f  inute  introductory  segf.^ent  was  prepared,  using  NASA  footage, 
in  which  the  viewer  "travelled"  to  tlie  moon  and  back,  then 
witnessed  the  launching  of  the  space  shuttle.     The  idea  was 
to  ipmedia.tely  rerund  the  viewer  that  tecnnology  lo  advancing 
rapidly  and  that  the  future  is  filled  with  potential  changes 
of  enormous  magnitude.     These  technological  triunphs  also 
f>xenipiif ied  the  kind  of  achi.evpjoent  that  urjcondng  generations 
or  student  >  will  hopefully  aspire  to. 

It  was  hoiked  that  eudiences  would  be  encouraged  by  i^uch 
footage,  to  consider  where  their  h.ic}i  schools  were  herit'lin'j 
and  how  they  would  need  to  adapt  to  the  rapid  trans ror;«at ion 
of  our  society.     Survey  '^esnonsps  did,  in  fact,  indicate  that 
the  spo^e  :i';taphor  v^as  very  effective.    Teachers  responded 
that  "''The  scenes  of  the  U.S.  epace  prograrn  suggested  the 
future"  (1.30),  " ::ichnolony"  (1.20),  and  "achiever..ent " 
(1.12).    These  shots  also  suggested  to  a  lesser  degree,  "the 
frcricier"   (.80)  and  "patriotism"  (.54).    When  asked  to 
ela.  orate  on  this  issue,  the  following  reactions  were 
recorded : 

"The  tax^e  ptakes  you  re '  "  ze  the  future  comes  quickly." 
"Schools  ar^  he: ding  for  frontiers  unknown." 
"Students  must  be  prepared  to  neet  the  future." 
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"New  horizons  to  explore  and  new  ch.Jlengps  to  ;'ie*et . " 
"The  future  is  new.,     it  ins;ures  nie." 
I  \\oi>9  that  responses  like  H>ese,  alonn  with  the  data 
reported,  have  convinced  man^'  reader^  that  a  television 
prograr^  can  contribute  signif  icanti  v  to  the  succespfnl 
initiation  of  m  institutional  chance  project.  Today, 
television  is  becominn  an  increasingly  cost-effective  r.iediuia. 
Video  technology  is  advancing  at  0  reparkable  ra^e. 
Television  portapaks  are  becorning  lighter,  easier-to  perate, 
less  expensive/  and  of  higher  quality.    Obtaining  respectable 
looking,  worthwhilp  footage  has  becone  econoi«dca3  ]y  feasible 
for  groups  which  previously  found  tite  cost  prohibitive. 
Fur therrnore/  an  inexpens-'ve  editor,  like  Panasonic's  R-500 
(5  $100.00),  can  be  connected  between  two  half-inch  recording 
units,  so  a  program  can  easily  be  asser»bled  fron  raw  footage. 

A  rf^spectable  television  progran  can  be  produced  quite 
parsimoniously  these  days,  especially  if  there  is  a  person  on 
your  staff  who  is  skilled  in  television  production.  Once 
leveloped,  a  video  has  large  potential  audiences,  especially 
given  the  rapid  proliferation  of  videocassette  recorders  in 
both  institutions  and  hordes,    "e  are  in  the  midst  of  a  "video 
revolution"  and  tjose  interested  in  promoti      a  special 
£)roj3ct  shoul  "  consider  taking  advantage  of  this  dynamic 
medium. 
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Platters  laden  with  fried  chicken  and  potatoes,  spaghetti 
smothered  in  tomato  sauce,  cream  cupcakes  and  chocolate  bars 
spin  slowly  round  on  the  scrG?n.    Oddly  enough,  these  treats 
aren't  displayed  to  tempt  you.    They  appear  as  reminders  of 
foods  you  should  avoid  eating. 

"Watch  nc  ,  and  start  to  say  good-bye  to  the  wrong  kinds 
of  foods,"  says  the  silky-voiced  female  narrator.    "With  daily 
viewing,  you  will  watch  your  desire  for  fattening  foods  simply 
disappear. " 

This  scene  was  from  the  twenty-two  minute  videotape,  "Weight  Loss  Pro- 
gramming," bv  Hypnovision,  that  was  designed  to  help  viewer?  lose  weight 
through  daily  viewing.    Besides  providing  basic  information  on  diet  and  exer- 
cise, the  video  used  visual  and  aural  subliminals.    The  visual  messages  were 
flashed  on  the  screen  for  one-thirtieth  of  a  second  at  regular  intervals  and 
the  audio  messages  were  compressed,  mixed  with  music  and  transmitted  just 
below  the  threshold  of  normal  hearing. 

Subliminal  perception  (or  stimulation)  describes  any  word,  image  or 
sound  that  is  not  perceived  within  the  "normal"  range  of  consciousness,  but 
makes  an  impression  on  the  mind.    This  involves  words  or  pictures  that  are 
flashed  so  quickly  that  the  eye  cannot  transmit  them  to  the  conscious  brain, 
or  words  at  such  a  volume  that  they  evoke  no  conscious  memory. 

This  past  year  a  variety  of  products  have  appeared  on  the  market  that 
heve  the  rystique  of  sublim-^'nals  and  promise  improvement  in  a  variety  of 
areas.    Audio  tapes,  with  the  subliminal  messages  transmitted  below  the 
threshold  of  audible  sound,  offer  to  transform  the  listener's  life.  Stimu- 
tech.  Inc.  has  a  device  that  interfaces  a  computer  with  a  television  allowing 
the  viewer  to  receive  subliminal  messages  while  watching  TV.  Greentree 
Publishers  offer  a  computer  program  that  allows  the  computer  operator  to 
write  one's  own  subliminal  messages.    These  messages  are  flashed  regularly 
dS  the  programmer  continues  on  with  other  computing  tasks.    Several  video- 
tape companies  produce  videotapes  like  the  one  described  above.    Most  of 
these  tapes  encourage  replacement  of  bad  habits  with  healthier  ones.  The 
ads  for  these  products  emphasize  that  the  subliminal  programs  will  help 
bring  about  dramatic  results  with  minimal  effort.    This  presents  an  attractive 
proposition  to  the  consumer.    However,  whether  they  do  what  they  claim  is 
open  to  debate.    Many  mental  health  professionals  and  psychologists  do  not 
agree  as  to  whether  subliminal  communication  is  effective  in  changing  human 
behavior  and  attitudes.    Second,  these  subliminal  products  have  been  intro- 
duced to  the  market,  yet  they  have  not  been  clinically  tested.  Silverman, 
formost  investigator  in  the  use  of  subliminal  stimulation  to  direct  manipu- 
lation of  behavior,  believes  that  companies  that  sell  subliminal  products 
designed  to  affect  bahavior  should  set  up  a  research  unit  that  tests  their 
products  (Levy,  1984).    Currently,  there  is  no  documentation  of  any  testing 
of  these  products  to  determine  the  effectiveness  of  their  subliminal  messages. 
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Purpose  of  Study 


The  purpose  of  this  revearch  was  to  conduct  a  study  to  determine  if 
viewing  a  commercially  prepa^^ed  videotape  containing  written  and  aural  sub- 
liminal messages  was  more  effective  at  producing  weight  loss  than  a  videotape 
containing  the  same  content  but  with  no  subliminal s. 

"Weight  Lo'    Video  Programming,"  by  Hypnovision,  the  videotape  selected 
for  this  study,  eridorsed  no  particular  diet  or  exercise  pl?n,  and  made  no 
requireme.tts  of  the  viewers  other  than  the  willingness  to  change  diet  and 
exercise  habits  and  to  watch  the  videotape  daily  for  thirty  days.    It  was 
felt  that,  while  weight  loss  was  not  a  traditional  focus  of  educational  re- 
search, the  availability  of  this  particualr  videotape  would  give  insights 
into  the  effectiveness  of  subliminal  messages  that  might  have  a  direct  re- 
lationship to  traditional  educational  needs.    Subjects  were  measured  to  see  if 
changes  occurred  in  these  areas: 

1)  BEHAVIOR 

Food  Intake  Recall  (FIR)--measured  by  one  day  food  recall  at  the  end  of 
the  testing  period.    This  analyzed  the  subjects'  food  intake  for  nutrients  and 
calories.    The  FIR  was  used  to  compare  the  amount  of  intake  of  high  calorie, 
low  nutritional  foods. 

Weight  and  Skinfold  Test  (WST)—  measured  at  the  beginning  and  end  of 
the  testing  period.  Skinfold  tests  reveal  and  approximate  percentage  of  body 
fat.  All  skinfold  tests  were  performed  by  the  same  physical  education  in- 
structor who  was  experienced  in  administering  skinfold  tests.  To  increase 
accuracy,  three  measurements  v;ere  taken  at  each  skinfold  testing  and  these 
scores  were  averaged.  Subjects  were  also  weighed  at  the  beginning  and  end 
of  the  experiment  on  the  same  scale,  by  the  same  person. 

2)  ATTITUDE 

Food  and  Exercise  Attitude  Test  (FEAT)--ddministered  at  the  beginning 
and  end  of  the  testing  period  to  measure  the  effectiveness  of  the  subliminal 
messages  on  the  tape:    "EAT  LESS",  "GET  ACTIVE",  "CALM",  EAT  SLOW",  "YOU  CAN 
DO  IT".    The  attitude  test  items  were  chosen  from  existing  food  attitude 
test  items  that  were  relevant  to  the  subliminal  messages  and  that  fell  into 
the  following  categories:    eating  for  internal  reasons,  eating  for  external 
reasons,  oral  control,  basic  diet  and  exercise  behavior.    The  subjects  re- 
sponded to  the  twenty  FEAT  questions  on  a  five-point  Likert  scale  (r  =  0.72). 


Treatment  groups 

1)  The  exper-^mental  group  consisted  of  viewers   v;ho  watched  the 
twenty-two  minute  Weight  Loss  videotape  with  subliminal  messages.    This  group 
was  composed  of  those  subjects  randomly  selected  and  pieced  in  the  yellow 

and  orange  groups. 

2)  The  control  group  consisted  of  viewers  who  watched  the  twenty-two 
minute  Weight  loss  videotape  without  subliminal  messages.    T^-'s  group  was 
composed  of  t  ^se  subjects  randomly  selected  and  placed  in  the  blue  and 
green  groups. 
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Hypotheses: 


The  general  hypothesis  was  that  subjects  receiving  subliminal  stimuli 
in  a  postlve,  emotionally  arousing  way  would  be  able  to  stop  a  related  and 
undesirable  type  of  behavior  (by  mirroring)  with  greater  success  than  subjects 
not  receiving  those  messages. 

1)  Subjects  viewing  the  videotape  with  the  subliminals  will  show  a 
greater  weight  loss  than  those  viewing  the  videotape  without  subliminals. 

2)  Subjects  viewing  the  videotape  with  the  subliminals  will  show  a 
greater  loss  in  percentage  fat  than  those  viewing  the  videotape  without 
subl iminals. 

3)  Subjects  viewing  the  videotape  with  the  subliminals  will  show  a 
better  attitude  toward  eating  healthier  foods  and  exercising  than  those 
viewing  the  videotape  without  subliminals. 

4)  Subjects  viewing  the  videotape  with  the  subliminals  will  record 
fewer  instances  of  high  calorie,  low  nutritional  food  intake  than  those 
viewing  the  videotape  without  subliminals. 

5)  Subjects  viewing  the  videotape  with  the  subliminals  will  be  able  to 
maintain  the  weight  loss  for  a  longer  period  of  time  than  those  subjects 
viewing  the  videotape  without  subliminals. 

Experimental  Design: 

Campbell  and  Stanley's  (1963)  experimental  design  number  four,  the 
Randomized  Pretest-Posttest  Control  Group  Design,   was  used  in  this  study. 
Students  were  randomly  selected  for  treatment  groups,  a  pretest  was  given 
and  preliminary  measurements  were  taken.    After  the  treJ^tmonts  were 
administered,  a  posttest  was  given  and  final  measurements  were  taken.  The 
import  of  the  treatments  was  determined  by  subtracting  subjects'  pretest 
scores  from  posttest  scores.    The  appropriate  test  for  significance  at  the 
.05  level  was  then- applied  to  ascertain  if  the  difference  was  greater  than 
what  might  occur  due  to  chance.    For  this  experiment,  this  design  was  con- 
sidered superior  to  others  (Campbell  and  Stanley,  1963). 

Dependent  Variables: 

1)  Measure  of  subject's  attitude  toward  food  and  exercise  (FEAT). 

2)  Measurement  of  subject's  behavior  toward  food  and  exercise  by 
change  in  weight  and  percentage  of  body  fat. 

3)  Measure  of  subject's  behavior  toward  food  and  exercise  by  incidence 
of  high  calorie-low  nutritional  food  intake  (FIR). 

Independent  Variable: 

1)    Videotape  viewed  by  subjects: 

A,  Vidootape  on  weight  loss  containing  subliminals. 

B.  Videotape  on  weight  loss  not  containing  subliminals. 
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Subjects: 


Subjects  participating  in  this  study  were  undergraduate  and  graduate 
students,  and  staff  ftom  Iowa  State  University  who  responded  to  advertisements 
in  the  campus  newspaper  or  to  flyers  posted  in  buildings  on  the  campus  dun nq 
Spring  Semester,  1985.    Those  interested  attended  one  of  three  orientation 
sessions.    The  orientation  sessions  were  conducted  to  explain  the  study,  to 
explain  the  participants'  responsibilities  and  to  answer  questions. 

Subjects'  responsibilities  were:    1)  to  get  a  signed  medical  clearance, 
2)  to  take  the  FEAT  pretest,  be  weighed,  and  be  given  the  skinfold  Jest,  3  to 
view  an  assigned  videotape  twenty-five  times  within  a  thirty-seven  day  period. 
4)  to  return  and  be  reweighed,  be  given  the  skinfold  test,  and  take  the  FIR 
and  FEAT  posttest.    If  subjects  met  those  requirements  they  were  paid  twenty 
dollars.    Medical  clearances  were  obtained  at  the  campus  health  service  at 
no  cost  to  the  participants.    Fifty-nine  subjects  started  the  study  and 
fifty-oi!3  fulfil l::d  all  the  requirements. 


The  Videotape: 

The  videotapes  used  in  this  study,  "Video  Weight  Loss  Programming", 
were  developed  in  1983  by  John  Koenig  of  Hypnovision.    Two  videotapes  were 
used:   one  with  visual  and  audio  subliminals  (the  ccmiercially  available 
version),  and  one  without  subliminals.    Each  videotape  was  twenty-two  minutes 
Ing  and  the  perceptible  content  of  each  videotape  was  the  same.    In  order 
to  accomodate  the  fifty-nine  subjects  viewing  the  tape  daily.  Hypnov.sion 
provided  eight  copies  of  each  version.    To  equalize  videotape  wear  and  hinder 
subjects'  knowledge  of  the  type  of  tape  they  were  assigned  to,  each  subject 
was  issued  a  color-coded  card.    Those  with  blue  and  green  cards  were  con- 
trol subjects.    They  watched  the  videotape  without  the  subliminals.  me 
yellow  and  orange  groups  (experimental  subjects)  watched  the  videotape  witn 
the  subliminals.    Tapes  were  viewed  at  the  university  library. 

The  content  of  the  videotapes  was  basic,  accepted  information  on  diet, 
exercise  and  weight  control.    The  videotape  opened  with  scenes  of  running 
water  while  the  narrator  urged  relaxation.    Plates  of  donuts    "ndy  bars  and 
fried  chicken  revolved  on  the  screen,  and  the  viewer  was  told  to  resist  these 
fSods  by  s  JJng,  "No  Thank  You."    During  the  course  of  the  videotape  viewers 
were  told  to  eat  slowly,  take  small  bitr.s  and  chew  thoroughly.    They  were 
instructed  to  drink  up  to  eight  glasses  of  water  ano  f^rcise  daily.  Several 
types  of  exercises  were  demonstrated  as  the  subliminal  audio  message,  YUU 
CAN  LOSE  WEIGHT  NOW"  was  repeated  200  times  during  the  music  sequence. 
The  visual  subliminals  were  one  frame  edits  that  were  flashed  every  five  to 
ten  seconds  at  a  speed  of  cne-thi rtieth  of  a  second.    This  was  below  most 
people's  ability  to  perceive  them.    These  messages  were   EAT  LESS  ,  bti 
ACTIVE",  "CALM",  "EAT  SLOW",  and  "YOU  CAN  DO  IT".    Both  videotapes  stated 
that  they  contained  subliminal  messages  and  the  messages  were  printed  on  the 
screen  during  the  introduction.    Both  videotapes  began  with  scenes  of  flow- 
ing water  and  viewers  were  told  to  relax.    As  the  name  of  the  company  --mplied, 
tho  vidpotape  attempted  to  put  the  viewer  in  a  relaxed  state  so  that  the 
information  and  the  subliminals  presented  would  have  more  of  an  e-tect. 
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Review  of  the  Literature: 


The  idea  of  whether  individuals  can  be  affected  by  their  environment 
without  conscious  awareness  has  fascinated  many  for  more  than  two  thousand 
years.    Spence  (1961)  described  the  mechanism  by  which  unconscious  stimuli 
can  affect  behavior.    According  to  Soence,  memory  traces  are  organized  in  the 
unconscious  into  semipermanent  aggregates  called  schemata.  A  schema  is  an 
organization  of  ideas,  memories,  and  concepts  that  are  lir>ked  through  associ- 
ation.   Subliminal  activation  of  a  schema  occurs  when  a  word  or  image  enters 
the  unconscious  and  becomes  attached  through  association  to  the  general 
schema.    Because  of  the  emotional  content  of  the  stimulus  and  because  memories 
and  ideas  already  comprising  the  schema  are  meaningfully  related,  the  subliminal 
stimulus  activates  the  entire  schema. 

Signal-detection  theory  (Swets,  Tanner  and  Birdsall,  1961;  Tanner  and 
Swets,  1954)  has  explained  how  unconscious  stimuli  can  be  processed  without 
conscious  awareness.    Signal  detection  theory  assumes  all  signals  impinging 
on  an  organism  contribute  to  a  continuum  of  sensory  activity  and  experience. 
All  signals  increase  the  probability  of  raising  the  excitation  level  to  a 
point  where  the  organism  will  report  the  signal's  presence.    The  organism 
makes  decisions  regarding  attending  and  responding  on  the  basis  of  decision 
rules,  that  are  based  on  the  comparison  of  incoming  signals  relative  to  the 
needs  of  the  organism.    Since  all  signals  are  processed,  all  information 
exists  within  the  organism.    Certain  information  is  attended  to  and  conscious- 
ly experienced  while  the  rest  does  not  gain  conscious  recognition.  Hence, 
some  experiences  are  filtered  out  before  they  reach  consciousness  because 
they  are  not  recognized  as  signals,  yet  they  are  still  processed. 

While  the  controversy  over  subliminal  perception  has  continued  on 
theoretical  and  empirical  grounds,  there  has  also  been  public  response  to  the 
subliminal  effect.    In  1957,  this  controversial  phenomenon  came  to  the  pub- 
lic's attention  when  patrons  in  a  movie  theater  in  New  Jersey  were  subjected 
to  "HUNGRY?    EAT  POPCORN",  and  "DRINK  COCA-COLA"  messages  flashed  on  the 
screen  every  five  seconds  throughout  a  film.    General  sales  figures  over  a 
six-week  period,  compared  with  previous  sales,  .increased  57.5%,  and  Coca- 
Cola  sales  by  18.1.%  (Brooks,  1958).    Use  of  this  technique  drew  immediate 
negative  responses  from  the  public.    People  did  not  want  th^ir  subconscious 
minds  influenced. 

The  foremost  investigator  in  subliminal  stimulation  in  psychology  has 
been  Lloyd  Silverman  (1976).    Silverman's  study  of  psychoanalytic  dynamic 
activation  relationships  involved  the  tachistoscopic  presentation  of  wish- 
related  verbal  and  pictorial  stimuli  for  provoking  unconscious  wishes  sub- 
liminally.    Psychoanalysts  have  posited  that  different  symptoms  of  abnormal 
behavior  are  related  to  different  unconscious  conflicts  and  that  symptoms 
can  be  viewed  as  symbolically  expressing  aspects  of  the  particular  under- 
lying conflict. 

Several  studies  have  suggested  that  both  situational  and  individual 
differences  are  related  to  the  strength  of  subliminal  effects,    ^isher  and 
Paul  (1959),  and  Fiss  fl966),  found  that  when  suoj?cts  were  in  a  state  of 
relaxed  passivity,  subliminal  effects  were  maximized.    Dixon  (1971)  suggested 
that  subliminal  effects  were  more  likely  to  be  found  when  subjects  were  in 
a  low  state  of  arousal.    In  this  case,  attention  was  unselective  and  cognitions 
were  intuitive,  global  and  unbond  by  logical  constraints.    On  the  other  hand, 
high  levels  of  arousal  tended  to  diminish  subliminal  effects. 
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Subliminal  stimulation  has  been  explored  In  the  area  of  learning  and 
education.    Five  general  areas  where  subliminal  perception  might  be  applicable 
to  education  were  in  the  areas  of  problem  solving,  cognitive  learning,  ino- 
tivation,  elaborative  thinking  and  perception  (DeChenne,  1981-82). 

Zuckerr.an  (1960)  had  subjects  produce  stories  after  viewing  the  sub- 
liminal messages  "WRITE  MORE"  or  "DON'T  WRITE".    Their  ability  to  produce 
stories  mirrored  the  message  they  received  subliminal ly.    When  presented  with 
supraliminal  messages  that  were  easily  recognizable,  "WRITE  MORE"  and  "DON'T 
WRITE",  the  performance  of  subjects  at  producing  stories  were  not  affected 
by  the  messages  they  received.    Zuckerman  felt  this  was  an  example  how  a 
subliminal  stimulus  could  by-pass  processes  of  conscious  intent  and  revealed 
that  it  might  be  impossible  to  resist  the  instruction  of  imperative  subliminal 
messages  that  were  not  consciously  experienced. 

Smith,  Spence  and  Klein  (1959)  tested  to  see  if  word  meaning  alone 
had  a  subliminal  influence  on  conscious  thought.  When  the  words  "ANGRY" 
and  "HAPPY"  were  exposed  subliminally  and  were  immediately  followed  by  a 
clear  supraliminal  figure  (a  blank,  expressionless  face),  the  subliminal 
words  influenced  impressions  of  the  latter.  Descriptions  of  the  face  were 
pleasant  in  "HAPPY"  pairings  and  unpleasant  in  "ANGRY"  pairings. 

Parker  (1982)  found  that  subjects  who  were  normal  college  students 
who  received  subliminal  stimulation  "MOMMY  AND  I  ARE  ONE"  and  "MY  PROF  AND 
^  ARE  ONE",  in  conjunction  with  teaching  and  counseling,  received  signifi- 
cantly higher  grades  than  similar  students  who  received  the  control  stimu- 
lation "PEOPLE  ARE  WALKING".  Parker  agreed  with  Silverman  that  subliminal 
stimulation  had  an  adaptive  enhancing  effect  on  behavior. 

Experiments  in  education  that  did  not  reveal  dramatic  positive  results 
of  subliminal  stimulation  included  studies  by  Severance  and  Dyer  (1973)  and 
Grant,  Blohm  and  Ledford  (1981).    Severance  and  Dyer  found  that  the  presence 
of  3  subliminal  color  interfering  word  did  not  affect  color  naming.  They 
further  questioned  if  subliminal  effects  were  restricted  to  those  that  pro- 
duced emotionally  laden  responses,  since  words  like  red,  blue  and  green  were 
neutral  and  lacked  emotional  meaning. 

Grant,  Blohm  and  Ledford  (1981)  investigated  the  effects  of  subliminal 
stimuli  on  the  development  and  improvement  of  execution  of  racquetball  ceil- 
ing shots,  and  increased  racquetball  participation.    Results  showed  that 
females  couli  possibly  be  affected  by  visual  subliminal  stimulation  to  a 
greater  degree  than  males,  and  questioned  if  filming  subjects'  performances 
and  presenting  it  to  them  subliminally  would  better  arouse  them  and  lead 
to  improved  learning  of  this  psychomotor  skill. 

These  studies  reveal  two  types  of  effects  i:hat  can  be  produced  by 
subliminal  stimuli:    the  mirroring  effect  and  the  effect  of  arousal  and 
learning  from  emotionally  laden  stimuli.    These  are  related  to  habit  break- 
ing and  habit  forming  behavior. 
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Attitudes  are  seen  as  endunng  predispositions  that  are  not  innate  but 
are  learned.    Thus,  eve.-  though  attitudes  are  not  momentarily  transient,  they 
are  susceptible  to  change  (Zimbardo,  Ebbesen,  and  Maslach,  1977).    In  1S31, 
Thurstone  demonstrated  the  impact  of  film  on  attitudes.    By  using  two  films, 
one  depicting  the  Chinese  favorably  and  the  other  unfavorably,  Thurstone 
found  it  was  possible  to  produce  either  positive  or  negative  changes  in 
attitude  toward  Chinese  people  (Thurstone,  1931). 


Though  media  are  mere  carriers  of  information  and  do  not  directly  in- 
fluence learning  under  any  condition  (Clark,  1983),  there  are  approaches  and 
techniques  using  media  that  seem  to  maxim^'ze  desirable  attitudinal  outcomes. 
Simonson,  at  Iowa  State  University,  has  been  investigating  the  topic  of  in- 
structional media  and  attitude  change  for  the  past  several  years  (1979,  1980, 
1981).    He  outlined  six  guidelines  that  can  promote  certain  attitudinal 
outcomes  in  learners.    The  guideline  most  relevant  to  this  study  was  guide- 
line SIX  that  stated:    Learners  who  experience  a  purposeful  emotional  involve- 
ment or  arousal  during  instruction  are  likely  to  have  their  attitudes  changed 
in  the  direction  advocated  as  the  purpose  of  the  mediated  message. 


It  has  often  been  reported  that  an  efficient  method  for  changing  behavior 
would  be  to  change  one  or  two  underlying  general  dispositions  or  att',.udes. 
Festinger  s  (1957)  theory  of  cognitive  dissonance  is  based  on  the  idea  that 
human  beings  demonstrate  a  great  desire  for  consistency  and  congruity  in' their 
attitudes  and  behaviors  and,  conversely,  find  conflict  between  what  they  know 
and^what  they  do  disturbing  and  discomfiting  (Zimbardo,  Ebbesen,  and  Maslach, 

Festinger  (1964)    suggested  that,  when  opinions  or  attitudes  are  changed 
through  the  impact  of  persuasive  communication,  this  change  is  unstable  and 
will  disappear  unless  an  environmental  or  behavioral  change  can  be  brought 
about  to  support  and  maintain  it.    The  data  show  that  the  occurrence  of 
behavior  change  does  not  depend  upon  the  prior  occurrence  of  an  attitude 
change,  or  vice  versa.    Greenwald  (1966)  contended  there  was  no  automatic 
relationship  between  attitude  and  behavior;  rather,  they  may  be  independently 
determined  by  the  environment.    Normally,  the  environment  will  produce  in 
persons  parallel  effects  on  belief  and  behavior,  so  these  concepts  will 
appear  to  be  correlated.    In  special  situations,  such  as  persuasion  following 
an  opposing  commitment,  the  environment  exerts  differential  pressures  on 
belief  and  behavior  and  then  they  appear  to  be  urcorrelated  (Greenwald,  1966). 


Summary: 

Subliminal  stimulation  is  a  phenomenon  that  has  been  shown  in  some 
instances  to  influence  basic  drives,  though  the  strength  of  these  effects 
seem  to  be  related  to  situational  and  individual  differences.  Subliminal 
effects  are  maximized  when  subjects  are  in  a  state  of  relaxed  passivity. 
High  levels  of  arousal  tended  to  diminish  subliminal  effects.  Subliminal 
stimulation  might  influence  learning,  and  two  effects  produced  by  subliminal 
stimuli  were  the  mirroring  effect  and  the  effect  of  arousal  and  learning 
from  emotionally  laden  stimuli. 
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M?dia  can  be  used  to  change  attitudes.  Le?* ners  who  experience  a  pur- 
poseful emotional  involvement  o»^  arousal  are  likely  to  have  their  attitudes 
changed  in  the  direction  of  the  mediated  message.  Change  in  attitudes  does 
not  necessarily  mean  a  change  in  behavior. 


Results: 

Hypothesis  1:    Subjects  viewing  the  videotape  with  the  subliminals  will 
show  a  greater  weight  loss  than  those  viewing  the  videotape  without  subliminals. 

The  descriptive  statistics  shown  in  Table  1  indicated  that  the  subjects 
assinged  to  the  weight  loss  videotape  with  subliminals  weighed  less  initially 
(x  =  139.47  lbs.)  than  those  assigned  to  the  weight  loss  videotape  without 
subliminals      =  141.53  lbs.).    After  weighing  at  the  end  of  the  treatment,  a 
change  in  weight  was  obtained  by  subtracting  initial  weight  from  weight 
after  treatment.    The  data  in  Table  1  indicated  that  the  viower'^  of  the 
videotape  with  the  subliminals  lost  an  average  of  1.84  pounds  compared  to  the 
control  group  which  lost  an  average  of  2.66  pounds.    Hypothesis  1  was  not 
accepted. 

Hypothesis  2:    Subjects  viewing  the  videotape  with  the  subliminals  will 
show  a  greater  loss  in  pprcentage  body  fat  than  those  viewing  the  videotape 
without  subliminals. 

The  descriptive  statistics  shown  in  Table  2  indicated  that  the  subjects 
assigned  to  the  weight  loss  videotape  with  subliminals  had  a  greater  per- 
centage of  body  fat  initially,  though  they  weighed  less  (Table  1)  than  subjects 
assigned  the  weight  loss  videotape  without  the  subliminals.    After  skinfold 
measurements  were  taken  at  the  end  of  the  treatment,  the  change  in  percentage  of 
body  fat  was  obtained  by  subtracting  initial  percentage  body  fat  from  perent- 
age  body  fat  after  treatment.    Table  2  indicated  that  the  viewers  of  the 
videotape  with  the  subliminals  lost  an  average  of  .41  percent  body  fat 
compared  to  the  control  group  which  lost  an  average  of  .53  percent  body  fat. 
Hypothesis  2  was  not  accepted. 

Hypothesis  3:    Subjects  viewing  the  videotape  with  subliminals  will  show 
a  better  attitude  toward  eating  healthier  foods  and  exercising  than  those 
viewing  the  videotape  without  subliminals. 

The  descriptive  statistics  shown  in  Table  3  indicated  that  the  subjects 
randomly  assigned  to  the  weight  loss  videotape  with  subliminals  scored  lower 
initially  on  the  FEAT  pretest  than  those  assigned  to  the  weight  loss  video- 
tape without  subliminals.    After  administering  the  FEAT  posttest,  the  change  of 
attitude  was  obtained  by  subtracting  pretest  scores  from  posttest  scores. 
The  data  reported  in  Table  3  indicated  that  the  viewers  of  the  videotape  with 
the  subliminals  showed  an   improved  attitude  toward  food  and  exercise  of 
11.18  points  compared  to  to  viewers  of  the  videotape  without  the  sublimine-ls 
that  showed  an  improved  attitude  toward  food  and  exercise  of  7.37  points. 
However,  the  difference  between  the  two  groups  was  not  statistically  sig- 
nificant, and  hypothesis  3  was  not  accepted. 
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Hypothesis  4:  Subjects  viewing  the  videotape  with  the  subliminal  ;  will  - 
record  fewer  incidents  of  high-calorie,  low-nutritional  food  intake  than  those 
viewing  the  videotape  without  subliminal s» 

The  descriptive  statistics  shown  in  Table  4  indicated  that  the  subjects 
assig'-ied  to  the  weight  loss  vidjotape  with  subliminal s  reported  an  average 
intake  of  3.15  servings  of  high-calorie,  low-nutritional  foods,  during  the 
24-hour  period  of  April  30  -  May  1 ,  after  treatment,  compared  to  the  control 
group  who  reported  an  average  of  2,21  servings.    Hypothesis  1  was  not  accepted. 

Hypothesis  5:    Subjects  viewing  the  videotape  with  the  subliminals  wMl 
be  able  to  maintain  the  weight  1  <;s  for  a  longer  period  of  time  than  those 
subjects  viewing  the  videotape  without  subliminals. 

The  descriptive  statistics  shown  in  Table  5  Indicated  that  a  random 
sample  of  eight  subjects  assigned  to  the  weight  loss  videotape  with  sublimi- 
nals reported  a  gain  of  .31  pounds  10  days  after  treatment  (May  10,  1985) 
compared  to  a  loss  of  .53  pounds  from  a  random  sample  of  nine  subjects 
assigned  to  the  weight  loss  videotape  without  subliminals.    The  change  in 
weight  was  obtained  by  subtracting  the  weight  after  treatment  on  May  1,  1985 
from  weight  on  May  10,  1985.    Hypothesis  5  was  not  accepted. 


In  order  to  attempt  to  determine  why  the  hypotheses  were  not  supported  by 
the  data,  in  post  hoc  research,  a  Pearson  correlation  was  utilized.    Thic  was 
to  determine  if  any  relationships  existed  between  the  variables  (Table  6). 
Statistically  significant  correlations  were  as  follows: 

1.  Change  in  weight  (difference  in  weight  between  initial  weighing  and 
weighing  after  treatment  )  was  inversely  correlated  to  change  in  sttitude 
(difference  in  attitude  toward  food  and  exercise  between  pretest  and  posttest). 
Specifically,  ac  weight  change  decreased,  che  change  in  attitude  was  more 

PC  itive.    This  result  was  opposite  of  what  was  expected. 

2.  Change  in  weight  (difference  in  weight  between  initial  weighing 
and  weighing  after  trsatment)  was  correlated  tc  FIR  (Food  Intake  Recall). 
As  weight  change  (loss)  increased,  the  incidence  of  high-calorie,  low- 
nutritional  food  intake  increased.    This  result  was  opnosite  of  what  was 
expected. 

3.  Age  was  correlated  to  change  in  body  fat  (diT^erence  in  percent  body 
fat  between  initial  measurements  and  measurements  taken  after  treatment),  as 
age  increas?d,  body  fat  percentage  changed  more. 

The  first  two  relationships  were  unexpected  and  difficult  to  explain. 
When  a  Pearson  Correlation  wa:  performed  only  on  the  experintental  group 
that  viewed  the  videotapt  with  the  subliminals,  the  correlation  between 
change  ir*  weight  and  change  in  attitude  was  not  significant.    Further  exami- 
nation is  suggested.    The  third  relationship  of  increase  in  age  to  increr.se 
of  body  fat  wcs  not  too  surprising.    The  majority  of  older  subjects  involved 
in  sedent&ry  jobs  did  not  have  as  much  available  time  to  exercise  as  the 
college  students.    Also,  older  women  tend  to  eat  less  raf^'^^r  than  increase 
exercise  for  weight  control. 
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After  completion  of  treatments,  subjects  were  given  a  questionnaire 
to  complete.    Questions  were  concerned  with  the  effectiveness  of  the  video- 
tape that  was  viewed.    Results  were  recorded  in  Table  7.    The  questions  asked 
and  a  summary  of  responses  are  recorded  below: 

!•    Do  you  believe  you  saw  the  tapes  with  the  subliminals? 

Ninety-three  percent  of  subjects  assigned  to  the  videotape  with  sublimi- 
nals believed  they  viewed  the  tapes  with  the  subliminals,  compared  to  twenty-one 
percent  of  the  subjects  assigned  to  the  videotape  without  subliminals. 

2.  Do  you  feel  the  tapes  are  effective? 

Seventy-four  percent  of  subjects  assigned  to  the  videotape  with  subliminals 
felt  the  tapes  were  effective,  compared  to  sixty-seven  percent  of  the  subjects 
assigned  to  the  videotape  without  subliminals. 

3.  How  did  the  tapes  help? 

Both  groups  reported  the  same  top  five  responses;  twenty-four  percent  in 
each  group  said  that  the  tapes  made  them  more  aware  of  the  foods  they  ate. 
Other  responses  indicated  the  tapes  made  them  feel  relaxed,  helped  them  eat 
less,  and  motivated  them  to  exercise  more  and  to  drink  more  water. 

4.  Would  you  like  to  continue  watching  the  tapes? 

Fifty-six  percent  of  the  subjects  assigned  to  the  videotape  with  subliminals 
respondend  yes.  compared  to  thirty- three  percent  of  the  subjects  assigned  to  the 
videotape  without  subliminals. 

5.  Would  you  consider  buyit  g  the  tape  if  you  have  a  VCR? 

Forty-two  percent  of  the  subjects  assigned  to  the  videotape  with  subliminals 
said  they  would  buy  it,  compared  to  thirty  percent  of  the  subject^  a^^s'nned  to 
the  videotape  without  subliminals. 

6.  Other  comments  you  might  have  about  the  experiment: 

Both  groups  reported  that  the  repetition  of  diily  viewing  became  Doring, 
but  the  videotape  would  be  good  to  view  before  eating.    A'l  other  comments 
are  recorded  in  Table  7. 


According  to  these  responses,  the  viewers  of  both  groups  were  generally 
awar3  if  they  were  or  v/ere  not  receiving  the  subliminal  messages.  However, 
the  viewers  assigned  to  watch  the  videotape  with  subliminals  were  more  favor- 
able to  the  continuation  of  this  type  ot  weight  loss  program.    The  majority 
of  both  groups  felt  the  videotapes  were  effective.    When  asked  how  the  tapes 
helped,  the  most  popular  response  for  both  groups  viewing  the  videotapes  was 
that  it  made  them  aware  of  what  they  ate.    The  importance  of  awareness  was 
stressed  throughout  the  content  of  the  videotape. 
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The  remainder  of  the  responses  from  both  groups  were  quite  similar. 
The  viewers  of  the  videotape  with  subliminals  received  the  subliminal  message 
"CUM",  although  viewers  of  both  groups  said  the  tape  relaxed  them.  Another 
subliminal  message  was  "EAT  LESS",  yet  both  groups  said  the  tape  helped  them 
eat  less  (ranked  third).    The  subliminal  message  "YOU  CAN  DO  IT"  was  flashed 
visually,  plus  the  audio  message  "YOU  CAN  LOSE  WEIGHT  NOW"  was  compressed  and 
transmitted  with  music  on  the  videotape  with  subliminals.    There  was  one 
difference,  however.  The  comment  that  the  tapes  encouraged  them  was  mentioned 
more  by  the  viewers  of  the  videotape  without  subliminals  than  by  the  viewers 
of  the  videotape  with  subliminals.    This  might  mean  that  the  subliminal 
messages  were  too  similar  to  the  ppeceptable  content  and  were  repetitious 
of  that  content,  so  that  possibly  the  subliminal  messages  were  rendered  in- 
effective. 

One  can  only  :>peculate  as  to  why  no  statistically  significant  results 
were  produced.    The  repetition  in  the  content  of  the  videotape  might  have 
rendered  the  subliminal  messages  ineffective.    Each  videotape  contained  the 
same  content  of  basic  diet  and  exercise  information  which  stressed  that  the 
viewer  should  eat  less,  exercise  more,  eat  slower  and  relax.    The  subliminal 
messages  were  precisely  the  same,  and  thus,  were  repetitious  of  the  video- 
tape's content,  and  this  reduced  their  effectiveness.    It  is  also  possible 
that  subliminal  persuasion  and  behavior  change  do  not  work. 


Recommendations  for  Further  Study: 

There  are  four  major  recommendations  for  those  who  would  replicate 
or  improve  th'iS  study.    One  is  to  improve  the  FEAT  pre-  and  posttest  to 
improve  its  reliability  and  ensure  its  validity.    The  second  recommendation 
is  to  start  the  study  earlier  in  the  school  year  to  allow  sufficient  time 
for  reweighing,  one,  two,  and  three  months  after  treatment. 

The  third  ^ecomrr.endation  would  be  to  recruit  participants  who  have 
access  to  kitchen  privileges.    This  would  allow  participants  to  more  easily 
apply  what  the  videotapes  advocated. 

The  fourth  recommendation  is  to  conduct  this  same  study  with  the  same 
tests  and  measures,  but  use  an  entirely  different  perceptable  topic,  such 
as  one  dealing  with  relaxation.    Have  on  group  view  the  videotape  without 
subliminal  messages  and  one  group  view  the  videotape  with  subliminal  message^ 
of  "EAT  LESS",  "EAT  SLOW",  "GET  ACTIVE",  and  "YOU  CAN  DO  IT".    After  obtaining 
measures  of  the  siibjects'  attitudes  and  behaviors  toward  foud  and  exercise, 
there  would  be  a  clearer  understanding  of  the  effectiveness  o^  the  subliminal 
messages,  regardless  of  the  subject  of  the  videotape. 

Summary  of  Conclusions: 

This  study  found  that  a  commercially  prepared  videotape  containing 
written  and  aural  subliminal  messages  was  not  more  effective  at  producing 
weight  loss  in  viewers  than  was  a  videotape  containing  the  same  content  but 
without  tne  subliminals. 
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Please  place  an  (X)  under  the  column  which  applies  be$t  to  each  of  the  numbered 
statements.    All  of  the  results  will  be  strictly  confidential.    Most  of  the" 
questions  directly  relate  to  food,  eating  and  exercise     Please  answer  each 
question  carefully.    Thank  you. 
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1.  I  am  aware  of  the  calorie  content  of  foods  I  eat. 

2.  I  eat  when  I  am  not  hungry. 

3.  I  eat  faster  than  others. 

4.  I  can  lose  weight  when  I  try. 

5.  I  follow  a  daily  scheduled  program  of  exercise. 

6.  I  am  self-conscious  about  my  weight. 

7.  I  exercise  because  I  enjoy  it. 

8.  Even  if  I'm  full,  if  something  looks  good  I'll  eat  it. 

9.  I  do  not  eat  some  foods  i/ecause  they  make  me  fat. 

10.  Eating  helps  me  relieve  depression. 

11.  I  drink  several  glasses  of  water  daily. 

12.  When  !  feel  rejected  or  lonely  I  eat. 

13.  If  I  am  hungry  I  eat  fast. 

14.  Exercise  makes  me  feel  calmer. 

15.  I  count  calories. 

16.  I  consciously  eat  less  than  what  I  want. 

17.  I  exercise  at  least  three  times  a  week. 

18.  I  am  very  conscious  of  what  I  eat. 

19.  When  I  get  nervous  I  eat. 

20.  I  cut  my  food  into  small  pieces. 
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Name 


Number 


Address 


Soc  Sec  No 


Checks  win  be  mailed  by  May  31  (the  latest) 


1) 


What  color  group  were  you  in? 


2) 


Do  you  believe  you  saw  the  tapes  with  the  subliminals? 
Why?  ^  


3)  Do  you  feel  the  tapes  are  effective?   

4)  How  did  they  help  you?  

5)  Would  you  like  to  continue  watching  them?   

6)  Would  you  consider  buying  the  tape  if  you  had  a  VCR? 

7)  Other  comments  you  might  have  about  the  experiment 


This  information  is  confidential.  Your  name  will  not  be  niven  out  or  placed 
on  a  mai 1 inq  list. 

Would  you  briefly  record  the  food  you  have  eaten  in  the  past  24  hours: 
Breakfast  Lunch  Dinner  Snacks 


Thank  you  very  much  for  your  participation!  Would  you  like  the  results  of  the 
study  sent  to  you  at  the  above  address? 
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Educational  Computing  Inservice  Design: 
Implications  from  Teacherr'  Concerns  Research 

Abstract 

This  paper  provides  an  overview  of  an  ongoing  research 
effort  studying  teachers*  concerns  about  educational 
computing.    Two  studies  are  reported*    The  first  study 
identified  teachers*  concerns  about  educational  computing 
and  monitored  how  these  concerns  changed  during  an 
inservice  activity.    Concerns  theory  hypothesizes  that  the 
concerns  of  innovation  users  are  developmental,  beginning 
with  self-orienteo  concerns,  evolving  through 
implementation-oriented  concerns,  and  progressing  to 
other-oriented  concerns.    The  research  findings  were  not 
consistent  with  the  hypothesis,  suggesting  that  the  nature 
of  the  inservice  and/or  the  characteristics  of  the 
innovation  (i.e.,  educational  computing)  may  affect  changes 
in  concern.    The  second  study  evolved  out  of  the  first  and 
examined  teachers'  concerns  about  educational  computing  by 
focusing  on  specific  educational  uses  of  the  technology 
(e.g.,  CAI,  word  processing.  Interactive  video).  The 
research  findings  indicated  that  different  uses  of  computer 
technology  elicit  different  concerns  about  the  technology. 
The  findings  suggest  that  inservice  designers  dealing  with 
educational  computing  should  recognize  educational 
computing  as  an  "innovation  bundle"  and  concentrate  on 
specific  applications  of  the  technology,  cather  than 
addressing  the  technology  whole-cloth. 
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Educational  Computing  Inservice  Design: 
Implications  from  Teachers'  Concerns  Research 

Before  teachers  can  take  full  advantage  of  computer 
technology,  they  must  modify  their  instructional  practices 
to  accommodate  the  technology.    Stevens  (1980)  stated  that 
two  major  factors  affect  implementation  of  educational 
computing:    teachers'     expertise    with  computers  and 
teachers'    attitudes    toward  computers.    Most  inservice 
attempts  focus  on  increasing  teachers'  computer  expertise 
while  paying  little  attention  to  teachers'  attitudes  toward 
the  technology.    Such  an  inservice  emphasis  is 
uaderstandable  given:    1)  the  growing  amount  of  information 
about  educational  couputing;  and,  2)  the  limited  amount  of 
information  regarding  teachers'  attitudes  toward 
educational  computing.    Thus,  a  research  base  focusing  on 
teachers'  attitudional  responses  to  computer  technology 
needs  to  be  established.    This  paper  reports  on  t^  j  studies 
of  teachers'  concerns  about  educational  computing.  The 
paper  reports  the  patterns  of  concerns  teachers  had  about 
educational  computing,  describes  how  these  patterns  changed 
during  an  inservice  effort,  and  examines  the  relationship 
between  teachers'  attitudes  toward  educational  computing 
and  specific  applications  of  computer  technology. 

Literature  Review 

Computer-related  inservice  design  is  in  its  infancy; 
the  professional  literature  frequently  fails  to  provide 
either  evidence  of  effectiveness  or  a  theoretical  framework 
to  support  the  design  suggested.    This  is  particularly 
evident  in  the  affective  dimension  of  inservice  design 
where  little  attention  has  been  given  to  the  adult  learner 
in  a  change  endeavor  involving  computer  technology. 

The  awareness  that  inservice  usually  involves  adult 
learners  is  an  important,  although  frequently  ignored, 
dimension  of  inservice  design  (Orlich,  1983).  Knowles 
(1970)  described  adult  learners  as  human  beings  who  draw 
heavily  upon  past  experiences,  are  more  problem-centered 
than  content  centered  with  immediacy  of  application  a  high 
priority,  and  are  highly  self-directed.    These  learner 
characteristics  are  manifested  in  inservice  programs  as 
learner  concerns. 

Teachers,  as  adult  learners,  bring  a  variety  of  past 
experiences  to  a  learning  situation.    Podemski  (1981) 
observed  that  many  teachers  have  had  limited  experience 
with  educational  computing  and  have,  insteadr  relied  upon, 
and  made  a  commitment  to  "non-computezized*  materials  and 
teaching  techniques.    Teachers  having  limited  experiences 
with  computing  may  reflect  concerns  related  to  simply 
gaining  awareness  about  educational  computing. 
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The  problem-centered  characteristic  of  the  adult 
learner  is  expressed,  in  the  area  of  educational  computing, 
as  a  strong  concern  for  more  effectively  meeting  the  needs 
of  students  (Stevens,  1982).    Also,  concerns  regarding  the 
effect  of  educational  computing  on  the  day-to-day 
management  of  the  new  technology  may  be  more  significant  to 
some  teachers  tha*^  the  acquisition  of  technical  expertise 
(Jarchow  &  Hunter,  1983).     If  an  inservice  program  does  not 
address  the  concerns  that  are  relevant  to  the  teachers, 
then  some  teachers,  as  adult  learners,  may  redirect  their 
attention  away  from  the  inservice  ani  perhaps  away  from 
educational  computing. 

Unders  jnding  how  adult  learners  r^.pond  to 
innovations  and  how  responses  change  as  a  result  of 
inservice  efforts  has  been  systematically  researched  using 
the  Concerns-Based  Adoption  Model  (CBAM)   (Hall,  Wallace  & 
Dossett,  1973) •    The  CBAM  suggests  that  inservice  efforts 
may  be  less  than  optimally  successful  because  inservice 
designers  fail  to  consider  where  teachers  are  in  the 
process  of  acquiring  new  attitudes,  understandings,  and 
skills  relative  to  the  given  innovation  (Loucke  &  Hall, 
1977).    The  model  suggests  that  when  adult  learners  engage 
in  a  new  learning  endeavor,  they  pass  through  predictable 
stages  of  concern.    These  stages  reflect  a  developmental 
movement  from  a  lack  of  awareness  concerning  an  innovation 
to  a  general  seeking  of  information,  to  personal, 
management,  and  consequence  concerns,  diid  finally  to 
concerns  regarding  collaboration  and  further  innovatj.on. 
Brief  definitions  of  the  stages  of  concern  are  shown  in  the 
Appendix. 

While  the  CBAM  ib  generally  accepted  in  the  inservice 
design  and  change  process  literature,  the  model  has 
received  limited  use  m  designing  or  researching 
educational  computing  inservice  efforts.    Bartel  (1984)  and 
Wedman  and  Strathe  (19^4)  used  the  stages  of  concern 
framework  to  design  faculty  development  programs,  but  did 
not  formally  assess  concerns.    Wedman  and  Heller  (1984) 
described  teachers'  concerns  before  they  entered  an 
inservice  effort  but  did  not  investigate  how  these  concerns 
changed  during  an  inservice  effort*    Thu^,  the  purpose  of 
Study  #1  was  to  test  the  cnr.nges  in  concetrs  as 
hypothesizeo  by  the  CBAM.    Jpecif i^cally ,  Study  #1  sFsessed 
teachers'  concerns  and  described  the  effect  of  an  inservice 
effort  on  thei;  concerns  about  educational  computing. 
Study  #2  evolved  out  of  Study  #1  in  an  effort  to  understand 
better         unpredicted  results  of  the  earlier  study. 

Methods  &  Findings:  Study  #1 

The  participants  in  Study  #1  were  classroom  teachers 
who  nad  volurcarily  enrolled  in  a  univerc  ty-offered 
course,  "Mi jrocomputers  in  Education,"  fo    which  they  paid 
their  own  tuition.    Sixty-five  were  females  (71%); 


ERIC 


753 


twenty-six  ^ere  males  (29%).    Forty-four  taught  elementary 
grades  (48%);  seventeen  taught  middle/junior  high  grades 
(19%);  twenty-six  taught  high  school  (29%);  four  taught 
grades  K-12  (4%).    The  teachers  varied  in  years  of  teaching 
experience  (one  to  forty-four  years)  and  amount  of  computer 
experience  (novice  to  computer  bcience  instructors) •  Both 
pre  and  post  data  were  collected  from  91  of  the  104 
participating  teachers. 

The  course  was  offered  at  six  different  sites  across  a 
central  midwestern  state  during  the  fall  of  1982  thru  the 
Spring  of  1984.    Each  offering  was  in  response  to  requests 
from  administrators  and  teachers  for  computer-related 
inservice.    The  course  consisted  of  30  hours  of  classroom 
instruction  and  several  out-of-class  assignments.  The 
actual  duration  of  the  inservice  course  varied  from  two 
weeks  (five  hours  per  day,  three  days  per  week)  to  eight 
weeks  (three  and  3/4  hours  per  day,  one  day  per  week) .  The 
course  placed  emphasis  on  transferring  course  content  to 
the  teachers'  own  practices.    The  same  content  was  used  in 
each  course  and  included  such  topics  as  microcomputer 
operation,  elementary  programing,  software  selection, 
evaluation,  and  utilization,  and  simple  authoring  systems. 

The  Stages  of  Concern  Questionnaire  (Hall  & 
Rutherford,  1976)  was  used  to  measure  teacher's  attitudes 
toward  educational  computing.    The  items  on  the 
questionnaire  represent  the  seven  stages  of  concern;  five 
items  comprise  the  scale  for  each  stage.    Estimates  of 
internal  consistency  (alpha  coefficients)  for  stages  range 
from  .64  to  .83.    Hall  and  Rutherford  (1976,  pp.  12-20) 
describe  several  studies  which  indicate  the  SoCQ  is  a  valid 
measure  of  the  hypothesized  concerns. 

The  SoCQ  was  administered  to  all  teachers  enrolled  in 
the  six  of^eringo  of  the  course.    The  preassessment  was 
conducted  during  the  first  class  meeting  prior  to  any 
discussion  of  the  course  or  its  content.    The  subjects  were 
told  that  the  results  of  the  questionnaire  would  be  used  to 
evaluate  the  effectiveness  of  the  course. 

The  SoCQ  was  scored  using  the  SoCQ  Quick  Scoring 
uevice  (Hall  &  Rutherford,  1976).    The  Quick  Scoring  Device 
converts  raw  scores  to  percentile  scores  for  each  stage  of 
concern.    A  higher  percentij.3  score  is  associated  with 
greater  concern  intensity.  Pro  and  post  data  were  then 
prepared  (compiled  and  averaged)  for  comparison  of 
teachers"  concerns  for  each  site  and  for  the  entire  group. 

For  interpreting  SoCQ  results.  Hall  and  Rutherford 
(1975)  suggest  that  "...due  to  the  nature  of  the  questions 
being  asked,  identification  of  trends  and  patterns  in  the 
date,  seems  more  valid  than  conducting  a  series  of  tests  of 
statistical  significance."  (p.  8)     Following  this 
suggestion,  each  teacher's  pre  and  post  SoCQ  percentile 
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bcores  were  graphed  thus  forming  "concerns  profiles."  The 
compiled  data  for  each  site  and  the  entire  group  were  also 
qraphicc.lly  represented. 

Examination  of  the  preassossment  profiles  revealed 
that  for  most  teacucrs  entering  the  inservice  course,  lower 
level,  more  self-oriented  concerns,  were  typically  most 
intense  (see  Figure  1).    These  informational  and  personal 
concerns  reflected  interest  in  the  general  charact2ristics 
of  the  innovation  and  the  relationship  between  one's  role 
and  the  demands  of  change.     In  addition,  however,  \t  was 
observed  that  approximately  1/3  o):  the  participants 
dirplayed  a  -two-humped"  profile  with  high  intensity 
concerns  in  both  inf o.-mation  and  collaboration  (See  Figure 
2).    This  profile  was  reflective  primarily  of  these 
individuals  who  had  considerable  computer  ex  .ritnce  iior 
to  the  inservice  effor.t. 


Figure  1. 

Preassessment  concerns  profile, 
entire  group,  St..>.y  #1. 


Figure  2. 

Preessessment  concerns  profile, 
"twc-humped, "  Stt  v  #1. 


75 


5 


7 


Analysis  of  the  postassessment  profiles  (see  Figure  3) 
revealed  several  unexpected  patterns.    While  the  work  of 
Louck3  and  Hall  (1977)  has  suggested  a  developmental 
progression  in  concerns  changes,  intermediate  concerns 
li.e.,  management)  typically  remained  lower  in  intensity. 
In  addition,  it  was  noted  that  the  intensities  of  higher 
level  concerns  (consequence,  collaboration,  and  lefocusing) 
increased  although  lower  level  concerns,  evident  in  the 
preassessme*it  profiles,  did  not  change  markedly,  somewhat 
in  contrast  to  the  progression  suggested  by  the  CBAM  model. 
Ct  should  also  be  noted  that  the  postassessment  profiles 
resembled  the  "two  humped"  profile  commonly  found  among  the 
experienced  individuals. 


Figure  3. 

Postassessment  concerns  profile, 
entire  group.  Study  #1. 


Discussion:     Study  #1 

The  preassessment  profiles  in  Study  #1  suggest  that 
inservice  providers  must  be  cognizant  of  the  heterogenity 
of  teachers'  concerns  about  educational  compucing. 
Inservice  experiences  for  many  individuals  need  to  address 
self-oriented  concerns  while  experiences  for  other 
individuals  need  to  address  both  self-oriented  and 
other-oriented  concerns. 

The  surpri    ,«jly  low  intensity  of  implementation- 
oriented  concerns  at  both  the  pre  end  postass^  ^mient  points 
raises  se^'  rax  questions.    The  low  intensity  may  be 
suggestivfc  of  the  nature  of  the  inservice  effort  itself 
which  encouraged  but  did  not  require  teachers  to  actually 
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implement  educational  computing  activities  in  their 
classroom.    Or,  perhaps  implementation-related  concerns  did 
not  become  intense  because  the  teachers  were  not  given 
sufficient  time  to  ful]v  implement  the  innovation  and 
manifest  implementation-related  problems  and  the  associated 
concerns,    it  may  also  be  poeited  that,  while  teachers 
became  comfortable  with  the  elementary  aspects  of 
educational  computing  (e.g.,  system  operation,  use  of  drill 
and  practice  software) ,  they  also  became  aware  of  more 
advanced  aspects  of  the  technology  (e.g.,  word  processing, 
interfacing  with  other  devices).    Thus,  the  postassessment 
profiles  may  be  actually  depicting  concerns  about  more  than 
one  aspect  of  educational  computing.    This  explanation  is 
consistent  with  the  multi-faceted  nature  of  educational 
computing  and  served  as  the  impetus  for  Study  #2  which 
examined  how  teachers'  concerns  vary  when  different  aspects 
of  educational  computing  are  considered,    it  was  predicted 
that,  if  teachers'  concernt?  do  vary,  then  more  familiar 
applications  will  be  ass      ated  with  more  advanced  staqes 
of  concern. 

Methods  &  Findings:  Study  #2 

In  Study  #2,  the  SoCQ  was  used  to  assess  teachers' 
concerns  about  different  aspects  of  educational  computing. 
Five  elementary  schools  (E-1...E-5),  one  middle  school  (M 
S),  and  one  high  school  (H  S)  from  a  midwestern  schoo] 
district  volunteered  to  participate  in  the  study.  Teachers 
at  the  schools  completed  one  of  four  randomly  selected 
versions  of  the  SoCQ,  each  version  focusing  on  a  different 
application,  specifically,  computer  assisted  instruction 
(CAI),  computer  managed  instruction  (CMI),  interactive 
vi^eo  (IV),  and  word  processing  (WP) .    The  teachers  were 
also  asked  to  complete  an  open-ended  concerns  question  for 
the  particular  application.    Table  1  lists  the  schools 
involved  in  Study  #2  and  indicates  the  number  of  teachers 
completing  each  version  of  the  SoCQ.    Concerns  profiles 
were  constructed  for  individual  teachers  and  groups  of 
teachers  responding  to  the  same  application  of  edutationa" 
computing. 


Table  1.    SoCQ  Questionnaire  Version  by  Schoo] s 


SoCQ 
CAI 

E-1  1 
4  • 

E-2  1 
4  1 

E-3 
5 

Schools 
1  E-4  ! 

1     5  1 

E-5 
3 

1  M  S 

BBC  r-SSBS 

1  8 

—  > 
1   H  S 

=  BXIS  SB 

12 

1  Totals 
1  41 

CMI 

5  1 

4  1 

5 

1     5  1 

3 

1  6 

14 

1  42 

IV 

4  1 

4  1 

6 

'     4  1 

3 

1  7 

10 

1  38 

WP 

6  1 

4  1 

6 

1     6  1 

2 

1     8  I 

16 

1  46 

Totals 

17  1 

■16  ! 

22 

1  20  1 

11 

1  29 

52 

1  167 
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Initial  examination  of  the  four  sets  of  group  profiles 
(by  application)  revealed  that  when  teachers  consider 
different  aspects  of  educational  computing,  different  types 
of  concerns  are  NOT  evident  (see  Figures  4a-d) .  This 
finding  appears  to  suggest  that  teachers*  concerns  about 
educational  computing  are  essentially  the  same,  regardless 
to  the  particular  application  being  considered.  Closer 
examination  of  the  concerns  data  revealed,  however,  that 
such  is  not  the  case. 


Figure  4a.     CAI  concerns 


Figure  4b.     CMI  concerns 


Figure  4c.     IV  concerns 


Figure  4d.     WP  conctins 
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When  the  individual  profiles  are  examined,  ^  different 
picture  becomes  evident.    By  examining  the  individual 
profiles,  and  noting  which  concern  has  the  highest 
intensity,  a  simple  matrix  of  concerns  by  applications  can 
be  created.     (Note:    in  those  cases  where  ♦:wo  concerns  had 
the  same  intensity,  the  open-ended  data  Wc,^  used  to  help 
classify  the  profile.)     Such  a  matrix,  shown  in  Table  2, 
can  be  used  to  identify,  for  a  given  application,  the 
percentage  of  teachers  having  a  particular  concern  as  most 
intense.    Three  patterns  are  noteworthy.    First,  the 
percentage  of  teachers  having  intense  awareness  concerns 
was  lower  in  CAI  than  in  other  applications.    Second,  the 
percentages  were  more  widely  cistributed  in  CAI  than  in 
other  applications.    Finally,  a  large  majority  of  concerns 
about  interactive  video  were  in  the  awareness  stage. 

Table  2.    Concerns  x  Application  Matrix 

Application 


stage  of 
Concern  | 

CAI 

1  CMI 

1  IV 

1        W?  1 

Awareness  | 

42% 

60% 

1  70% 

i      59%  1 

Information  1 

35% 

26% 

1  23% 

29%  1 

Personal  I 

15% 

12% 

1  7% 

8«  1 

Managentent  | 

e% 

2% 

4%  1 

Consequences     |        —      |        —      |        —      |        —  | 

Collaboration  I        —      |        —      |        —      1       —  | 

Refocusing        |        —      |        —      |        —      |        —  | 

Note      Cell  entries  indicate,  for  a  given  application,  the 
percv ntage  of  teachers  whose  concerns  were  most  intense  for 
a  particular  stage  of  concern. 

Discussion:     Study  #2 

The  variation  in  teachers*  concerns  about  different 
educational  computing  applications  was  not  evident  in  th" 
composite  group  profiles.    Yet,  when  the  concerns  data  was 
considered  on  an  individual  basis,  important  differences 
became  evident.    Teachers •  concorns  about  educational 
computing  do  vary,  depending  on  which  application  is  being 
considered.      This  finding  seems  to  support  the  notion  tiiat 
educational  computing  is  an  "innovation  bundle,"  that  is,  a 
collection  of  several  specific  innovations  each  of  which 
elicit  potentially  different  concerns.    The  finding  is  also 
consistent  with  the  resultr  of  Study  #1  in  that  the 
two-humped  profiles  may  have  actually  been  representations 
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of  concerns  about  more  than  one  innovation.    Study  #2  also 
suggests  that  inservice  designers,  evaluators,  and 
researchers  need  to  focus  on  specific  aspects  of 
educational  computing  rather  than  on  the  entire  innovation. 

Conclusion 

This  paper  reported  on  two  jcudies  examining  teachers* 
concerns  about  educational  computing.    Collectively,  the 
studies:  suggest  that  educational  computing  is  an  innovation 
bundle  rather  than  a  single,  unitary  innovation.  If 
educational  computing  is  an  innovation  bundle,  then  the 
problem  for  inservice  designers  is,  in  part,  one  of 
"unbundling*"  the  innovation.    Care  should  be  taken, 
however,  to  not  mistake  the  end  result  of  sucn  an  analysis 
as  a  blueprint  for  designing  inservice.    Some  instruciicnal 
design  theories,  for  example,  Reigeluth's  (1979) 
elaboration  theory,  suggest  that  instruction  should  be 
organized  in  a  general  to  specific  structar^'.  Educational 
computing  content  readixy  lends  itself  to  sach  a  structure. 
An  inservice  program  designed  to  expose  teachers  to  several 
aspects  of  educational  computing  could  serve  ^is  the 
"epitome."    Later  inservice  efforts  would  then  concGnlrc*te 
on  more  specific  aspects  of  educational  computing.    As  che 
inservice  begins  to  focus  on  more  narrowly  defined 
applications,  the  inservice  designers  should  then  Dtgin  to 
collect  and  use  concerns-related  data  as  part  of  their 
audience  analysis. 
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Appendix 

Definitions  of  Stages  of  Concern  About  the  Innovation, 


Stage  Title 

0  Awareness 

1  Information 

2  Personal 

3  Management 

4  Consequences 

5  Collaboration 

6  Refocusing 


Definition 

Unaware  of  or  unconcerned  about 
the  innovation. 

Concerned  about  the  general 
characteristics  of  the  innov  tion. 

concerned  about  the  relationship 
between  one*s  role  and  the  demands 
of  the  innovation. 

Concerned  about  the  management  and 
organization  of  the  innovation. 

Concerned  about  the  impact  of  the 
innovation  on  student  outcomes. 

Concerned  about  working  with 
others  using  the  innovation. 

Concerned  about  something  better 
than  the  innovation. 
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It  13  a  cunnmon  and  generally  accepted  feeling  among  many  graduate 
students  that  they  are  neccmers  to  a  profession  and  therefore  .'ley  should 
be  seen  and  not  heard,  sit  ocediently  at  the  feet  of  experts  to  calch  pearls 
of  wisdom,  and  generally  play  a  subserviar.t  role  'A.thin  a  professional 
association.  This  perception  is  just  not  true  of  AECT! 

'.  .is  is  not  to  'Jeny  that  tnere  is  a  great  deal  to  gcin  from  "rubbing 
elbows"  with  the  scholars  and  leaders  in  the  field  by  associating  with 
them  et  AECT  functions.  These  contacts  should  be  approached,  however, 
with  the  assurance  that,  as  graduate  students  in  a  rapidly  evolving  field, 
you  have  a  great  d^al  to  contribute  to  that  growth  end  change.  I  will  try'to 
outline  0  few  ol  the  v/eys  in  which  this  can  be  done. 


1   Introduce  a  fresh  viewpoint  and  perspective 

You  r  jst  be  aware  that  you  ere  growing  up  and  maturing  in  the 
computer  generation.  Many  of  the  established  leaders  in  our  field  came  out 
of  the  lantern  slide  generation.  These  two  groups  think  differently  This 
is  not  to  say  that  ihe  elder  generation  hasn't  developed  some  dramatic 
mnuvations  end  thoughtful  insights.  It  is,  however,  to  emphasize  that  you 
ere  able  to  pick  up  where  they  left  off  and  approach  instruction  from  a 
significantly  different  perspective 
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2  Challenge  Ireditj OP 


A  lot  of  whet  hes  been  done  ir  education  made  good  sense  et  the  time 
end  under  th-:-  CKcumstontcs  in  r/hich  it  wsc-.  de'-'eloped  A  tiockground,  t 
foundation,  a  tradition  are  all  necessey  elements,  of  a  field.  But  they  can 
not  be  pe.'Trntted  to  dominate  a  field  -  particularly  the  one  in  which  we 
work  Voj  are  in  the  best  position  to  suggest  alternatives  to  some  of 
these  tre'litions  and  require  that  ell  of  us  exemine  the  basic  premises  end 
assumptions  upon  which  we  operete.  Be  prepered  to  fail  end  be  wrong  but 
don't  let  that  inhibit  you  from  venturing  in  new  directions. 


3.  Pi ovide  a  balance 

As  you  chellenge  tredition,  recognize  th?  besis  end  velue  of  that 
treditmn  In  so  doing,  help  the  profession  to  echieve  an  eppropnate 
be^ance  between  residuel  elements  of  the  pest,  which  continue  to  provide 
value,  and  the  exciting  new  dimensions  of  cutting-edge  technololgies.  The 
concept  of  belance  is  important  Leening  too  fer  m  either  direction  ofteri 
ceuses  e  system  to  topple  end  fall. 


4  Provide  vitelity  to  the  orofession. 

Vou,  with  your  youth  and  new  perspective,  ere  in  e  unique  position  to 
add  a  sperk  of  vitelity  to  professionel  getherings.  This  is  ^ot  to  imply 
that  en  assembly  of  meture  professionel s  is  necessarily  dull  Indeed, 
quite  to  the  contrary!  But  your  seniors  in  this  field  are  both  enriched  end 
inhibited  by  the  past  You,  unshackled  by  much  of  whut  came  before,  can 
enrich  v/isdom  with  openminded  enthusiesm 


5  Get  involved  end  serve 

A:tu8lly  this  is  not  primarily  something  thet  you  can  do  for  AECT  end 
ti,e   -n'ession  Rather,  as  you  contribute  your  time  end  enercjy  it  is,  in  the 
long  ruii,  something  that  the  profession  ^an  do  ^or  you  It  is  difficult  ^or 
me  to  conceive  of  an  individual  being  able  to  make  significant  progress 
professionally  without  this  type  of  involvement.  The  personal 
relationships  and  networks  that  ore  achieved  are  invaluable     your  csreer 
develops.  I  can  not  :-ven  estimate  the  number  of  times  tfiet  I  have  needed 
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informeticin  or  assistance  when  I  have  been  able  tu  pick  up  the  telephone 
ond  cftll  soo'ieorie'  ^v^■J  i  met  M'lrough  n'ly  professiof;?;''  irr-'clverrieri^  "iie 
more  involved  ynu  are,  the  more  people  that  you  meet  and  the  more  you 
develop  that  network  of  support  It  is  a  very  positive  v?rsion  of  the  old 
saying  that  it  isn't  what  you  know  but  who  you  know 

6.  Develop  e  special  network  among  other  graduate  students. 

A  ftw  years  ago  a  nr^ajor  effort  was  initiated  to  develop  a  network  of 
groduote  students.  All  graduate  programs  were  contacted,  c  student 
representative  was  identified  at  each  one,  and  a  regular  newsletter  was 
circulated.  Urifortunately,  it  was  a  time  when  AECT  was  absorbed  in  a  lot 
of  other  priorities  and  the  effort  was  abandoned  after  about  a  year  I  think 
that  the  tirne  is  now  right  for  such  an  project  an^  vvould  challenge  you  to 
initiate  a  graduate  student  network.  I  would  be  glad  to  provide  some 
backgrou.  j  from  the  past  effort  to  assist  in  getting  the  idea  underway.  In 
fact,  at  one  time  it  was  even  suggested  that  such  a  group  might  seek 
division  status  in  AECT.  One  wag  even  proposed  that  it  be  known  as  the 
Division  of  Graduate  Students  or  DOGS  He  felt  that  it  was  an  appropriate 
acronym  in  lirht  of  the  life  that  he  was  leaJing  in  graduate  school! 

AECT  has  a  tradition  of  planning  activities  which  will  bring  together 
the  experienced  professional  along  with  the  younger  newcomers  to  the 
field.  You  are  the  ones  who  provide  one  of  those  two  important  dimensions 
to  our  profession  I  invite  and  urge  you  to  capitalize  on  this  significant 
professional  role 
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The  topic  of  this  paper,  or  something  very  much  like  it,  has 
become  a  fixed  feature  of  the  program  of  AECT  conventions. 
Whether  this  means  that  the  planners  of  each  year's  program  do 
not  pay  attention  to  what  has  been  presented  on  previous 
occasions,   whether  each  attempt  at  addressing  the  question  has 
failed,  or  whether  there  is  a  genuine  and  sincere  concern  that  we 
constantly  ask  each  other  what  researchers  in  educational 
technology  should  be  doing,   is  not  clear. 

This  year's  examination  of  the  issue  attempts  to  answer  four 
over-arching  questions.  The  four  questions  are: 

i.  What  is  the  nature  of  inquiry  in  Educational 
Technology? 
ii.  What  do  we  need  to  find  out? 

iii.  How  do  we  go  about  it? 
iv.  What  do  we  do  with  our  findings? 
Less  cryptically,  these  questions  point  to  a  need  to  examine:  why 
we  do  research  in  our  area  and  what  the  characteristics  of  that 
research  might  be;  the  ty^  ;5  of  research  questions  we  should  and 
should  not  be  asking;  what  are  the  most  appropriate  .Tiethodologies 
for  finding  answers  to  our  research  questions:  and  what  are  the 
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characteristics  of  a  report  of  research  that  make  it  "good"  and 
utlimately  suitable  for  publication.  Let  me  repeat,  however,  that 
a  number  of  wiser  heads  than  mine  have  tackled  these  questions 
before  and  have  come  to  conclusions  that  are  generally  in 
agreement  with  those  that  I  shall  present.  The  reader  might  wish 
to  consult  these  sources.  (Torkelson,  1977;  Salomon,  1978,  1979; 
Wilkinson,   1980;  Clark,   19d3;  Gerlach,  1984;  Heinich,  1984;  and 
many  others). 


In  a  recent  address,   Lee  Shulman  (1985)  observed  that 
arguments  about  the  modes  of  inquiry  that  are  common  in  the 
social  sciences  are  almost  totally  absent  in  the  "hard"  sciences. 
By  and  large,  physicists,  chemists,  astronomers  and  the  like  take 
methodology  for  granted.  They  agree  about  how  research  should  be 
done.  There  are  two  reasons  for  this.  The  first  is  that  the 
social  sciences  are  younger  than  the  natural  sciences  and  have 
had  less  time  to  arrive  at  a  consensus  over  methodology.  The 
second  is  that  the  factors  that  social  scientists  study  are  mere 
cc.r.plex  and  less  clear  cut  than  those  studied  by  their 
counterparts  in  the  "hard"  sciences. 

Shulman's  observation  would  be  reason  enough  for  beginning 
this  paper  with  a  look  at  the  nature  of  inquiry  in  our 
discipline.  But  the  matter  does  not  end  there.  If  one  looks 
carefully  at  the  literature,   one  is  left  with  the  impression 
that,   with  some  notable  exceptions,  the  matter  of  the  nature  of 
inquiry  in  our  field  has  never  been  addressed  adequately.  We  do 
not  have  a  clearly-defined  "philosophy  of  science"  to  guide  us* 
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The  exceptions  will  be  familiar  to  most  of  you.  They  include  some 
of  the  central  ideas  set  down  by  Heinich  (1970,   1984)  about  the 
nature  of  Educational  Technology,  the  discussion  of  the  role  of 
prescriptive  theory  by  Reigeluth  (1983)  and  by  Clark  (1983).  The 
issue  is  also  addressed  less  directly  by  Jonassen  (1984)  in  his 
philosophical  analysis  of  mediation,  Brody  (1982),  who  describes 
a  "functionalist"  agenda  for  research  on  pic:ures,  and  Streibel 
(1985,   &  in  press)  in  his  critical  analysis  of  educational 
computing.  Notice  that  I  have  not  listed  any  of  the  numerous 
papers  at  previous  conferences  dealing  with  naturalistic  research 
laethods    This  does  not  mean  that  these  papers  have  no  value.  They 
certainly  do.  But  they  do  not  delve  deeply  enough  to  define  the 
nature  of  iiiquiry  in  oar  field. 

The  purpose  of  inquiry  in  any  discipline  is  simply  to  find 
things  out.  We  find  things  out  for  a  number  of  reasons,  not  least 
among  which  is  that  we  are  by  nature  curious.  This,  of  course,  is 
a  terrible  truism,  which  is  why  we  tend  not  to  dwell  uj  :n  the 
point  when  we  initiate  people  into  research.  But  the 
satisfaction  of  curiosity  is  supremely  rewarding,  and  from  this 
satisfaction  comes  the  enj oyment  one  gets  from  doing  research.  It 
is  sad  that  so  many  graduate  j  tudents  feel  that  doing  research  is 
drudgery,  or  worse,  and  that,  largely  because  of  this,  they  do  no 
more  once  they  have  their  dissertation  out  of  the  way.  (Maybe,  as 
Clark  (1978)  implied,   this  is  also  the  attitude  of  their 
supervisors,    in  which  case  they  are  at  a  double  disadvar  -e). 
But  the  fact  remains  that  research  is  very  satisfying,  whether  it 
leads  to  a  significant  contribution  or  rot.  Put  another  way, 
there  is  nothing  wrong  with  doing  research  for  its  own  sake. 


76S 


Research  4 


Frequently  our  obsession  with  coming  up  with  "significant"  or 
"practical"  results  makes  us  devalue  the  work  that  we  really 
enjoy,  and  turns  us  away  from  doing  more. 

The  curiosity  that  inquiry  satisfies  is  curiosity  about  why 
things  are  the  way  they  are,  and  why  they  behave  the  way  they 
do.  Research  therefore  becomes  a  quest  for  explanations.  In  our 
area,  this  might  involve  explanations  of  why  one  instructional 
method  succeeds  where  another  does  not,  why  some  delivery 
technologies  are  thought  of  as  more  reliable  or  easier  to  learn 
from  '^•.han  others,  why  administrators  will  spend  money  on  some 
technologies  and  nou  others,  why  smart  students  learn  better  from 
some  instructional  methods  than  less  able  students,  and  so  on. 
The  explanations  that  researchers  find  for  such  phenomena  will, 
one  hopes,  fit  together  in  non-cont  radictory  ways  into  a  body  of 
theory  which,  in  turn,  will  direct  us  towards  what  explanations 
to  seek  after  next.  This  is  the  familiar  cycle  of  research 
building  theory  from  which  research  hypotheses  are  derived,  and  is 
described  in  any  research  methods  text.  The  result  of  this  type 
of  inquiry  is  descriptive  theory  that  is  typical  of  the  natural 
scien  es   (Simon,  1981). 

A  number  of  scholars  in  our  field  find  even  greater 
satisfaction  when  the  explanations  they  find  are  applicable  to 
practical  problems,  in  these  cases,  the  purpose  of  research  is 
the  generation  of  prescriptive  theory.  It  is  this  type  of  theory 
that  guides  the  decisions  that  instructional  designers  make,  a 
process  that  is  the  pivot  around  which  the  whole  field  of 
Educational  Technology  turns.  As  Reigeluth  (1983)  has  stated, 
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prescriptive  instructional  theory  consists  of  an  integrated  set 
of  principles  that  state  which  methods  to  use  given  certain 
outcones  to  attain  and  conditions  under  which  instruction  is  to 
occur.  Simply  put,  these  principles  take  the  form:  "if  x  and  y 
then  do  2".  For  example,  if  yo.       nt  students  to  be  able  to 
solve  word  problems  involving  fractions  (outcome),  and  if  the 
students  know  how  to  perform  the  four  basic  arithmetic  operations 
on  fractions  and  have  high  fluid  ability  (conditions) , 
prescriptive  theory  might  point  to  using  an  inductive  method  with 
lots  of  feedback.  A  number  of  scholars  in  our  field  have  drawn 
together  bodies  of  prescriptive  theory  from  research  that  are  of 
value  to  instructional  designers.  These  include  all  of  the 
authors  in  Reigeluth's  (1983)  volume,  the  work  of  Fleming  and 
Lcvie  (1978),   and  t\ie  prescriptions  for  designing  concept  lessons 
offered  by  Merrill  and  Tennyson  (1977). 

Inquiry  in  our  field,  then,  serves  three  purposes:  it 
satisfies  our  curiosity  about  the  way  things  are;  it  leads  to  -^he 
discovery  of  explanations  about  what  happens  when  people  learn, 
interact  with  technologies,  and  so  or:  and  it  allows  the 
development  of  prescriptive  theory  that  can  inform  decision- 
making. It  does,  however,  have  one  other  important 
characteristic,  which  Shulman  (1981)  described  as  having  viethod 
or  orderliness.  Regardless  of  which  particular  research  paradigm 
you  subscriha  to  —  experimental,  historical, 

ethnomethodological,  phenomenological,  evaluation  —  al5  mq^Jiiry 
that  is  worth  anything  is  rigorous.  What  this  means  -  aries  from 
paradigm  to  paradigm.  However,  scholars  of  every  xlna  should  be 
able  to  point  to  examples  rigorous  of  inquiry  within  thei.t 
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specializations.  It  is  terribly  wrong  to  think  of  one  paradigm  as 
being  necessarily  better,  than  another.  But,  as  we  all  know,  some 
experimental  researchers  look  down  upon  naturalistic  inquiry  as 
somehow  less  rigorous  and  inferior,  while  some  naturalistic 
researchers  scorn  experimental  research  for  lacking 
applicability.  Such  divisive  squabbles  are  counterproductive  and 
unnecessary.  It  is  far  better  to  accr  yt  different  standards  of 
rigor  (see,  for  example,  Cuba,  1981)  and  acknowledge  that  all 
types  of  good  research  make  a  contribution  to  our  field. 

At  the  risk  of  belaboring  the  point,  I  would  like  to  take 
this  argument  one  step  further.  Increasingly,  we  read  that 
prescriptive  theory  and  design  are  unnecessary,  and  that  we 
should  rely  upon  the  expertise  of  teachers  and  other 
professionals  "in  the  field='  to  make  instructional  decisions  (see 
Nunan,  1983).  However,  the  same  standards  of  rigor  must  apply 
here.  The  ability  of  expert  professionals  to  "reflect  in  action" 
(Schon,    1983)  must  not  be  thought  of  as  a  pretext  for  sloppiness. 
Decisions  based  upon  experience,  intuition,  hunches  and 
"plausible  reasoning"  (Hunt,   1S82)  need  to  be  just  as  sound  and 
carefully  deliberated  as  decisions  based  upon  a  more  formal 
prescriptive  theory. 

What  do  we  need  to  find  out? 
A  number  of  scholars  have  reviewed  the  progress  of  research 
in  Educational  Technology  over  zhe  years,  and  have  been  able,  from 
this  historical  perspective,  to  point  to  the  gaps  in  what  we  know 
(Torkelson,   1977;  Clark,   1983;  Gerlach,   1984).  This  approach  has 
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also  led  to  the  conclusion  that  we  have  not  been  asking  the  right 
research  questions,  that  we  hava  not  been  trying  to  find  out  what 
it  is  really  important  to  know. 

The  development  of  research  in  our  area  is  generally 
acknowledged  to  have  followed  the  following  stages: 

1.  Media  comparison  studies,  in  which  the  effectiveness  of 
one  medium  is  compared  to  that  of  another  medium  or  to 
"traditional"  classroom  instruction.  Clark  (1983),  among  others, 
has  demonstrated  convincingly  that  this  research  is  a  complete 
waste  of  time  becausr"  there  is  nothing  intrinsic  in  the  media  by 
which  instruction  is  delivered  that  can  possibly  affect  how  and 
what  people  learn. 

2.  Media  attribute  studies.  Here,  researchers  attempted  to 
identify  specific  attributes  of  the  different  media  which  made 
them  unique  and  which  might  account  for  differences  in  outcomes 
when  different  media  were  used  to  teach.  Again,  there  are 
conceptual  and  merhodological  difficulties  with  studies  of  this 
kind  which  preclude  their  contributing  much  of  value  to  theory. 

3.  Aptitude-Treatment  Interaction  research.  Snow  and  Salomon 
(1968)  pointed  out  a  long  time  ago  that  differences  in  student 
aptitude  and  ability  would  "mask  out"  main  effects  in  media 
research,  and  that  they  should  be  included  as  factors  in  research 
designs  in  our  £^eld.  A  great  many  studies  have  now  been 
conducted  using  the  ATI  paradigm,  often  claiming  to  find 
interactions,  although,   again,  there  are  many  methodological 
problems  that  make  the  majority  of  these  studies  suspect 
(Cro-ij::ach  and  Snow,  1977)  . 

4.  Learning  strategies  research.  While  not  within  the 
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"maj.nstream"  of  educational  technology  research,  a  great  deal  of 
work  is  now  being  conducted  on  the  strategies  students  use  to 
learn  (Brown,   1961;  Brown,  Campione  and  Day,  1981).  Just  because 
a  student  has  ability  in  a  particular  cognitive  skill  does  not 
mean  that  the  ability  will  be  used  to  learn  when  it  is 
appropriate  to  do  so.  The  use  of  strategies  by  students  is  an 
important  area  for  researchers  in  our  field  to  address. 

5.  Research  on  students'  attributions.   Saloiron  (1981,  1982, 
1983,    1984)  and  Clark  (1983)  both  state  that  the  importance  of  a 
particular  instructional  technology  derives  from  the  value  and 
difficulty  attributed  to  learning  from  it  by  students.  Again, 
this  research  is  not  yet  thought  of  as  "mainstream"  educational 
technology  research.  However,  it  points  towards  an  important 
future  development. 

This  evolution  of  research  illut, crates  both  the  good  and  the 
bad,  the  productive  and  the  less  productive,  in  what  we  have  done 
in  the  past.  Generally,  the  more  recent  research  is  more  valid 
and  describes  things  more  accurately,    (although  there  are  still 
people  doing  media  comparison  studies,   in  spite  of  the  fact  that 
we  know  they  are  a  waste  of  time).  Also,  this  type  of  research  is 
conclusion  ori.  ted,  and  represents  only  part  of  what  educational 
technologists  do.  We  have  a  considerable  tradition  of  decision 
oriented  research,  which  is  conducted  undar  the  rubric  of 
"Instructional  Developrcent".  From  our  past  research,  we  have 
learned  some  useful  things  about  how  student  characteristics  are 
related  to  different  instructional  methods,  though  this 
information  is  too  fragmented  to  qualify  as  an  instructional 
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theory.  We  are  beginning  to  discover  the  relationships  amcng 
task,  student  characteristics,  methods  and  strategies  that 
students  actually  use.  We  have  a  clearer,  though  by  no  means 
complete  picture  of  the  cognitive  processes  that  underlie 
learning  associated  with  memory,  attention,  recall,  imagery, 
problem  solving,  and  so  on.  On  the  other  hand,  for  all  our 
efforts,   we  have  no  theory  that  relates  media  or  technologies  to 
learning  (nor,  some  might  say,  is  such  a  theory  potentially 
interesting  nor  even  possible).  We  have  very  poor  procedures  for 
making  instructional  decisions  based  upon  the  most  recent 
cognitive  research.  All  of  the  design  models  I  can  think  of  are 
built  upon  behavioral  premises  and  principles.  Such  prescriptive 
theory  as  we  have  is  so  incomplete  as  to  appear  incoherent  at 
times,   and  is  made  up  of  rnstructional  principles  that  might  have 
"local"  validity,  but  which,  by  and  large,   are  not  particularly 
robust  or  generalizable. 

From  this,   it  is  possible  to  identify  some  things  we  should 
be  finding  out.  Whether  these  will  develop  into  future  trends  or 
remain  pious  hopes  remains  to  be  saen.  We  shall  look  first  at  two 
general  research  areas,  and  then  at  several  more  specific  types 
of  question. 

Prescri^  tive  Instructional  Theory . 

We  must  continue  to  conduct  conclusion-oriented  research  to 
uncover  prescriptive  instructional  principles  which  will  fit 
together  in  a  coherent  and  srable  theory.  In  spite  of  a  great 
clamor  to  the  contrary  (Phillips,  1983;  Eisner,  1984),  there  is 
still  a  need  in  education  for  both  principles  derived  from 
experimental  research  and  heuristics  derived  through  qualitative 
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modes  of  inquiry  (see  Howe,   1985).  Indeed,  there  is  increasing 
evidence  from  Philosophy  (Schon,   1983),   Cognitive  Science  (Hunt, 
1982)  and  Artifical  Intelligence  (Feigenbaunv,   1985)  that  both 
experimentally  verifiable  factual  knowledge  and  intuitive  tacit 
knowledge  are  necessary  for  the  development  of  the  levels  of 
expertise  required  for  the  successful  execution  of  higher 
cognitive  processes.  An  "expert"  uses  experience  and  intuition  to 
fill  in  what  theoretical  principles  do  not  deal  with.  Likewise, 
an  expert  system  relies  on  a  knowledge  ba?=:e,  derived  from  public 
knowledge,  and  a  set  of  heuristics,  derived  from  human  experts, 
in  order  to  function. 

Our  research  must  therefore  attempt  to  discover,  verify  and 
establish  as  complete  a  prescriptive  theory  of  instruction  as 
possible,  on  the  understanding  that  its  inevitable  incompleteness 
can  be  made  up  for  by  capturing  the  heuristic  knowledge  of 
experts.  This  research  requires  that  we  continue  to  seek 
knowledge  about  the  factors  that  are  necessary,  not  merely 
sufficient,  to  bring  learning  about  (Clark,   1983).  In  practical 
terms,  this  requires  the  study  of  basic  cognitive  processes, 
human  abilities,  learning  strategies,  and  attributions  of 
learners'  successes  and  failures  to  the  various  methods  and 
technologies  we  employ  when  we  teach.  These  factors  are  highly 
interdependent,  and  deserve  study  in  contexts  where  that 
interdependence  is  not  destroyed,  and  even  becomes  the  object  of 
the  study  itself. 
Decision  Orienced  Research. 

Hfeinich  (1984)  has  made  the  point  that  the  most  important 
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type  of  research  for  educational  technologists  to  conduct  is  that 
which  leads  to  solutions  to  prc^ctical  problems  within  contexts  in 
which  the  complexity  of  the  "real  world"  has  not  been  "controlled 
for"  as  it  is  in  experimental  research.  The  emphasis  is  on  the 
application  of  knowledge  to  solve  problems,  and  loudly  echos  the 
definition  of  "Technology"  upon  which  our  field  is  built 
(Galbraith,  1969) . 

There  are,  I  believe,  three  aspects  to  this  kind  of  research 
that  need  to  be  considered.  The  first  of  these  is  the  development 
and  validation  of  procedures  for  conducting  decision-oriented 
research.  The  procedures  that  we  have  to  do  this  —  our 
instructional  development  and  design  procedures  or  "models"  — 
have  by  and  large  been  developed  intuitively.  As  Gerlach  (1984) 
has  pointed  out,  with  rare  exceptions,  they  have  net  been 
submitted  to  the  kinds  cf  empirical  testing  that  we  require  of 
the  postulates  of  theory.  Gerlach  would  have  us  study  the 
behavior  of  educational  technolgists  themselves,  requiring  that 
design  models  become  independent  variables  in  research  studies. 
In  this  Way,  we  would  be  able  to  ascertain  whethar,  and  which, 
design  procedures  result,  ultimately,   in  superior  student 
performance.  We  have  not  yet  answered  the  research  question:  does 
following  a  design  or  development  model  Lead  to  superior 
instruction? 

Second,  we  need  to  develop  ways  of  studying  complex  systems 
without  having  to  dismember  them.  Precisely  what  needs  to  be 
done  in  this  regard  is  less  clear.  However,  the  concepts  and 
metliodologies  of  General  System  Theory  (Bertalanf fy,  1968)  would 
serve  as  a  good  place  to  start.  By  and  large,   I  believe  that 
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educational  technologists  have  completely  missed  the  point  of 
System  Theory,  ana  have  confused  being  "systemic"  with  being 
"systematic"  (Davies,   1981).  The  so-called  "system  approach"  has 
resulted  in  little  more  than  "models"  of  linear  procedures  which, 
if  followed,  lead  from  the  statement  of  a  goal  to  the  creation  of 
a  unit  of  instruction.  The  emphasis  is  heavily  biased  towards 
"front-end"  analysis  and  field  testing,   with  little  guidance 
being  given  at  the  decision-making  stage  where  methods  are 
selected  to  match  the  conditions  and  outcomes  that  the  analysis  has 
clarified.  The  real  purpose  of  System  Theory,  however,  was  to 
provide  ways  of  managing  great  complexity,  originally  in  living 
organisms.  The  decisions  through  which  instructional  methods  are 
selected  require  that  we  deal  with  such  great  complexity. 
Students  are  very  complex,   and  the  multivariate  nature  of 
learning  and  instruction  simply  cannot  be  dealt  with  by  our 
terribly  naive  "system  approach".  What  we  nee.d  to  find  out  is  how 
whe  ways  for  df;aling  with  complexity,  suggested  by  those  few 
educational  technologists  who  have  really  understood  System 
Theory,  can  be  applied  in  practice  to  the  making  sound,  though 
complex,   instructional  decisions.  The  work  of  Heinich  (1970)  on 
the  complexities  of  the  management  of  instruction,  of  Pask  (1984) 
on  self-organization  in  complex  systems  involving  students  and 
instructors,    and  of  Winn  (1975)  and  Beckwith  (1984)  on 
open  system  models  of  learners,   is  instructive  in  this  regard. 

Finally,  we  need  to  treat  ID  projects  very  seriously  as  case 
studies.  Obviously,  the  primary  purpose  of  an  ID  project  is  to 
get  a  problem  solved  as  efficiently  and  effectively  as  possible. 
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However,   we  lose  a  great  deal  of  valuable  inf ormaticn  every  time 
that  those  in  charge  of  a  project  fail  to  describe  it  in  the 
literature.  I  have  argued  elsewhere  (Winn,   1981)  that  ID  is  a 
valid  and  valuable  form  of  research.  By  the  standardb  that  are 
applied  to  experimental  research,   ID  falls  short  when  it 
comes  to  generalizability  of  findings.  Because  ID  projects  set 
out  to  solve  local  one-shot  problems,  and  because  few  variables 
if  any  are  controlled,   one  might  argue  that  the  experiences  would 
be  so  specific  to  that  one  case  that  they  could  not  possibly  be 
of  interest  to  other  developers.  But  it  is  a  question  of  whether 
the  mug  is  half  empty  or  half  full.  Looking  at  it  the  other  way 
around,  rhere  are  certain  common  elements  in  every  ID  project: 
there  is  a  '-client",  a  need,  a  goal,  a  set  of  objectives,  a 
solution,  try-out  and  implementation.  How  each  of  these  is 
handled  differently  under  different  circumstances  is  very 
instructive,  especially  when  one  considers  that  the  developer 
seeking  "methods"  which  might  help  in  a  particular  project  will 
certainly  be  intelligent  enough  to  adapt  the  suggestions  of  a 
fellow  developer  to  fit  his  own  needs  more  precisely.  The  case  study 
seems  to  be  the  best  way  to  accomplish  this,  and  educational 
technologists  should  be  encouraged  to  use  it. 

The  following  specific  research  needs  and  questions  are  not 
presented  in  any  particular  order.  They  encompass  both 
conclusion-  and  decision-oriented  research. 
Metacoqnitlon. 

There  is  increasing  evidence  that  students  are  capable  of 
monitoring  their  own  cognitive  performances  and  of  making 
deliberate  changes  in  the  strategies  they  use  to  learn  (Brown, 
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1981;  Brown,  Campione  and  Day,   1S81).  This  is  generally  seen  as 
something  to  be  desired,   for  it  allows  students  control  over  what 
and  how  they  learn.  There  is,  however,  a  Catch-2  2  as  far  as 
educational  Lechnologists  are  ^oncernea.  It  involves  the  question 
of  who  knows  best,  the  designer-instructor  or  the  student?  For 
example,  if  an  instructional  designer  chooses  a  ^articular 
instructional  method  on  the  basis  of  prescriptive  theory, 
expertise,  or  what  has  worked  in  the  past,  thei  it  is  assumed  that 
the  method  is  indeed  the  best,  given  the  circumstances.  Now,  if 
the  student  monitors  his  performance  and  decides  that  another 
riethod  would  be  better,  who  is  right?  On  the  one  hand  one  might 
argue  that  if  students  "interfere"  with  what  an  "expert"  has 
decided  is  best,  then  design  is  a  waste  of  time.  On  the  other 
hand,  if  students  do  indeed  know  more  about  what  is  good  for  them 
than  designers  can  possibly  know  on  the  basis  of  their  meagre 
learner  analysis,  then  design  helps  students  take  the 
intermediate  step  between  complete  novicehood  and  mastery  of 
learning  strategies.   In  either  case,  design  becomes  unnecessary. 
But  in  the  latter  instance,  the  rea'sons  for  this  are  positive. 

What  comes  out  of  this  conundrum  is  the  apparent  need  tor 
research  into  the  relationships  among  prescription  and  learner 
control  of  instructional  methods.  Some  work  has  already  been 
carried  out  on  this  problem  (Carrier,  Williams  and  Davidson, 
1985;  Tennyson,  Christensen,  Walsh  and  Hajovy,  1985)  in  the  study 
of  comp'^ter-assisted  learning.  However,  we  need  to  find  out 
whether  the  prescription  of  methods  by  designers  or  instructors 
is  antithetical  to  or  facilitativr  of  metacognitive  skill  in 
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students.  In  this  way  it  should  be  possible  to  identity  at  what 
-point  a  student  should  be  allowed  to  ...ake  metacognitive  decisions 
rather  than  abide  by  prescribed  ones. 
Perceptions  of  Me^^  and  Technologies. 

The  work  of  Salomon  (1981,   1982,   1983,   1984)  on  attributions 
of  qualities  to  media  by  students  hrs  opened  up  a  ^ew  area  that 
educational  technologists  should  study.  The  suggestion  is  that 
the  effects  and  ef fectiveneiss  of  different  media  and  delivery 
technologies  are  determined  mostly  by  how  the  students  perceive 
them.  This  includes  whether  the  medium  is  considered  to  be  "easy" 
or  "hard",  whether  the  student  thinks  it  is  worthwhile  putting 
any  effort  into  it,   and  so  on.   In  addition  to  Salomon's  work, 
Krendl  has  studied  the  effect  of  "set"  (Krendl  and  Watkins,  1983) 
and  "preconceptions"  (Krendl,    x985)  on  television  viewing. 
Salomon  (1985)  has  turned  his  attention  towards  similar  questions 
invol/ing  computers.  These  studies  serve  as  models  for  others  to 
follow. 

Technological  Constraints. 

While  it  has  been  established  (Clark,   1983)  thav  it  is 
instructional  methods  that  have  an  influence  oi;  learning  rather 
thai,  media  or  delivery  systems,  the  efficiency  ;/ith  which  methods 
can  be  used  is  frequently  constrained  by  the  technologies 
available  for  the  delivery  of  instruction.  Thus,  while  Clark  has 
claimed  that  a  teacher  can  use  any  method  that  a  technological 
medium  can,  it  might  not  be  very  efficient  for  the  teacher  to  do 
so  (see  Petkcvitch  and  Tennyson,   1985).  For  example,   it  is 
theoretically  possible  for  a  teacher  to  have  54  000  overhead 
transparencies  on  file  in  a  classroom,  which  the  teacher  selects 
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from  as  needed.  However,  to  do  this  is  impractical,  and  far  less 
efficient  than  using  a  videodisk  for  the  same  purpose.  Likewise, 
it  is  far  less  practical  to  have  students  commute  hundreds  of 
miles  to  class  each  week  than  to  have  them  study  pre-packaged 
self-instructional  materials  in  their  homes. 

We  therefore  need  to  find  out  about  the  efficiency  of 
various  combinations  of  instructional  methods  and  delivery 
technologies  in  order  to  add  a  practical  dimension  to 
prescriptive  theory  concerning  instructional  methods.  A  recent 
study  by  Wager  (1986)  appears,   at  first  glance,  to  be  yet  another 
media  comparison  study.  In  it  he  compares  CAI  and  television  for 
teaching  army  teletype  operators.  However,  he  was  not  interested 
in  whether  one  technology  taught  the  soldiers  mor'^^  or  better  than 
the  other.  His  concern  was  in  cost  effectiveness,  and  a  large 
part  of  his  data  consists  of  detailed  costing  out  of  teaching  via 
the  two  technologies.  This  is  a  very  useful  type  of  study  to 
conduct,  and  we  need  to  do  more  of  them  with  a  variety  of  methods 
and  delivery  rystems. 
Optimization  Methods. 

Tha  roots    ^f  instructional  design,  some  claim  (Glaser, 
197S),   lie  in  Simon's  book  The  Sciences  of  the  Artificial  (Simon, 
1969).  Here,  Simon  describes  design  as  a  process  whereby 
decisions  are  optimized  on  the  basis  of  the  demands  of  a  task  and 
the  constraints  that  are  imposed  upon  its  performance. 
Optimization  procedures,  such  as  statistical  decision  theory, 
work  very  well  in  some  sciences,  like  engineering  and  maybe 
medicine.  However,  as  Glaser  has  mentioned  (1976),  they  only  work 
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in  Education  in  "trivial"  instances.  This  is  because,   as  we  saw 
above,  education  is  concerned  with  complex,  multivariate 
processes  that  we  do  not  yet  fully  vinderstand,   let  alone  control. 
However,  this  does  not  mean  that  more  precise  procedures  for 
instructional  decision-making  should  not  be  sought  after.  The 
speed  and  capacity  of  today's  computers  makes  it  possible  to 
handle  those  very  complex  multivariate  situations  that 
instructional  decision-making  is  involved  with.  Some  work  has 
begun  on  this  problem,  again  in  CAI  research.  Tennyson  and  his 
colleagues  (Johansen  and  Tennyson,   1983)  have  developed  the 
'Minnesota  Adaptive  Instructional  System  (MAIS)  which  has  some  of 
the  attributes  of  a  complex  instructional  decision-maker.  The 
algorithms  involve,  among  other  things,  the  calculation  of  of 
probabilities  using  Bayesian  statistics.  We  need  other 
mathematical  models  of  chis  type  to  help  us  optimize 
instructional  decision-making. 
"Expert"  Design  Systems. 

Everyone  is  talking  about  "expert  systems".  These  are 
computer  programs  in  which  has  been  captured  the  intuitive  tacit 
knowledge  of  experts,  expressed  as  decision  rules  through  the 
agency  of  "knowled^'^e  engineers".  We  need  to  find  out  whether  it 
is  feasible  and  practical  to  capture  the  expertise  of 
instructional  designers  in  this  way  and  create  expert  systems 
that  do  instructional  design. 

This  would  be  relatively  easy  to  do.  But  the  next  logical 
step  is  less  simple.  If  we  can  create  expert  instructional  design 
systems,   it  should  be  possible  to  create  CAI  systems  that  design 
Themselves  as  thsy  interact  witzi  students.  In  other  words,  the 
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prescriptive  principles  embodied  in  an  instructional  theory  would 
be  "invented"  by  the  i:ystein  as  it  "got  to  know"  each  student  it 
was  teaching.  In  effect,  a  separate  theory  of  instru.ction  would 
develop  for  eacu  student,  offering  the  ultimate  in  adaptive 
instruction. 

Significant  steps  have  already  been  taken  towards 
constructing  these  self-designing  systems.  They  are  to  be  found 
in  self-improving  intelligent  tutoring  systems,  developed  by  such 
researchers  as  Kimball  (1982)  ^nd  O'Shea  (1982).   These  systems 
function  by  changing  instructional  strategies,  either  on  the 
basis  of  how  well  the  student  is  doing  or  arbitrarily  at 
predetermined  intervals,   and  seeing  whether  or  not  the  chenge  in 
strategy  improves  or  degrades  the  student's  performance.  The 
algorithm  is,   once  again,  based  upon  probability.  Based  upon  the 
success  of  the  strategy,   it  is  either  retained  or  changed  again. 
We  need  to  find  out  how  effective  such  self-improving  systems 
are,   and  to  develop  more  sophisticated  algorithms  for  the 
modification  and  retention  of  instructional  strategies. 
Presentation  Formats. 

With  the  advent  of  intelligent  tutoring  systems  (Sleeman  and 
Brown,   1982)  comes  the  need  for  developing  a  whole  variety  of 
ways  of  displaying  information  to  students.  To  date,  the  natural 
languages  that  have  been  used  in  intelligent  CAT  have  been  verbal 
langauges,   like  English,   French  and  Russian.  However,   research  on 
the  effectiveness  of  graphics  (Wirn,   1986),  pictures  (Levin, 
Anglin  and  Carney,   1986)  ana  videotex  (Winn,   Ellis,  Flatter, 
Sinkey  and  Potter,   1985)  in  instruction  has  firmly  established 


ERLC 


784 


Research  19 

that  other  ways  of  presenting  information  are  now  as  feasible  to 
use  as  text,  and  are  often  more  effective.  The  problem  is  that  in 
order  to  ^et  information  from  a  knowledge  base  in  a  computer,  be 
it  constructed  from  decision  rules,  a  network  of  propositions  or 
one  of  many  logics,  into  a  form  that  the  student  can  comprehend 
requires  routines  that  themselves  follow  particular  sets  of 
rules.  In  the  case  of  verbal  language,   these  rules  are  the 
language's  syntax.   There  is  no  syntax  for  the  non-textual 
representation  of  knowledge.  A  number  of  scholars  have  attempted 
to  describe  grammars  of  pictures  and  graphics  (Doblin,  1980; 
Szlichclnski,   1980).  However,  we  simply  do  not  know  enough  abcut 
how  pictures  ana  graphics  convey  meaning  to  enable  us  to  write 
decision  rules  for  CAI  with  the  same  power  and  precision  as  the 
rules  we  have  when  screen  presentations  are  textual.  There  is  a 
tremendous  amount  of  research  to  do  in  this  area  before  we  can 
begin  to  exploit  these  forms  of  representation  to  their  fullest. 

There  are,   of  course,  other  things  we  need  to  find  out.  But 
any  report  of  "future  trends"  must  limit  itself  to  the  most  likely 
to  be  manageable.  I  believe  that  the  items  just  mentioned  are 
pretty  "sure  bets"  for  the  future  of  research  in  our  field. 

Methodology 

A  section  on  methodology  is  expected  in  a  paper  such  c  s 
this.  However,  given  the  plethora  of  papers  and  articles  on  the 
methodology  of  educational  research  that  have  appeared  recently, 
what:  I  have  to  say  on  the  matter  will  probably  be  redundant,  I 
wi]l  therefore  be  brief. 

First  we  must  remind  ourselves  that,  whatever  method  we  use 
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to  conduct  our  research,  we  must  apply  it  with  discipline  and 
rigor.  The  arguments  in  support  of  this  contention  were  made 
earlier,  besides  whicn  they  should  be  obvious. 

Second,   let  us  not  forget  that  our  discipline  is  concerned 
with  both  conclusion-  and  decision-oriented  research.  The 
methodologies  for  each  differ,  as  we  all  know.  Again,  recall  the 
arguments  made  above  that  instructional  development  is  a  form  of 
research,  and  that  the  data  instructional  developers  gather 
should  be  reported. 

As  far  as  the  current  debate  about  qualitative  versus 
quantitative  methods  is  concerned  (Phillips,   1983;  Eisner,  1983; 
Smith,   1983;  Miles  and  Huberman,  1984),  I  am  bothered  by  the 
feeling  I  get  that  proponents  of  each  class  of  method  are 
proposing  alternatives  to  rather  than  complements  to  the  other 
class  of  method.  Given  the  eclectic  nature  of  research  questions 
in  our  discipline  (and  in  Education  generally),  we  must  have  ar 
our  displosal  a  whole  battery  of  methods  to  deal  with  the 
different  types  of  things  we  need  to  find  out. 

There  are  a  number  of  ways  in  which 
experimental/ quantitative  and  naturalistic/qualitative 
methodologies  can  complement  each  other.  Kowe  (1985)  has  stated 
that  "quantification  extends,   refines  and  crosschecks  qualitative 
knowledge"  (p.   10).  Cn  the  other  hand,   it  is  now  common  for 
experimental  researchers  to  do  what  Bronfenbrenner  (1976) 
suggested  ten  years  ago  to  improve  the  ecological  validity  of 
controlled  experiments:   talk  to  the  subjf  :ts  afterwards  about 
what  they  learned,  how  they  did  it,  what  they  thought  of  the 
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experiment,  and  so  on.  So  we  should  try  to  use  quantification, 
where  appropriate,  to  sharpen  our  interpretation  of  qualitative 
data,   and  to  use  what  we  might  call  "post-experimental 
debriefing"  of  subjects  in  controlled  experiments  to  find  out 
more  about  the  subjects  and  how  they  learned. 

The  work  of  Winn  and  Everett  (1979)  and  Mclsaac,  Mosley  and 
Story  (1984)  illustrates  one  way  to  do  the  former.  In  these 
s+"udies,  factor  analysis  and  multidimensional  scaling  were 
applied  to  subjective  ratings  of  pictures  in  order  to  make  them 
more  interpretable.  This  type  of  study  is,   of  course, 
"reactionary"  in  the  sense  that  it  still  purports  to  enjoy  a 
measure  of  experimental  control.  However,  it  is  not  a  big  step 
from  there  to  what  Howe  suggested  —  the  application  of  relevant 
quantitative  techniques  to  data  gathered  through  observation. 

To  date,  I  have  observed  that  educational  technology 
researchers  have  spent  far  more  time  telling  us  why  we  should  be 
using  naturalistic  methods  than  they  have  doing  naturalistic 
studies.  Maybe  this  is  because  we  are  still  a  little  bit  afraid 
that  these  studies  are  less  likely  to  be  published.  Or  maybe  it 
betrays  our  "behavioral"  roots  and  the  accompanying  belief  that 
ail  of  the  behavior  that  is  of  interest  is  amenable  to 
quantification.  Be  that  as  it  may,  there  is  certainly  not  the 
activity  in  educational  technology  research  as  there  is  in 
research  in  teaching  and  learning  in  classrooms,   for  example. 

However,  I  believe  that  naturalistic  inquiry  has  just  as 
important  a  role  to  play  in  Educational  Technology  research  as  it 
does  in  ether  areas.  A  study  by  Eastman  (in  press)  serves  as  a 
model  of  the  kind  of  work  I  have  in  mind.  Eascman  gathrred  data 
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by  observing  students  working  with  comouters  and  computer 
printouts  in  a  language  arts  class  over  a  period  of  several 
months.  Her  application  of  the  techniques  of  naturalistic  inquiry 
(see  Cuba,   1981)  to  safeguard  the  validity  of  the  results  is 
exemplary.  Her  results  shed  much  light  on  how  students  think  of 
computers,   and  how  this  affects  the  ways  in  which  they  use  them. 
And  the  type  of  information  she  reports  could  not  have  been 
obtained  in  an  experimental  study. 

In  sum,  then,  I  believe  that  the  future  trends  in 
ir.ethodology  in  Educational  Technology  will  generally  follow  the 
trends  in  Education  as  a  whole.  That  is  to  say,  we  shal]  see  more 
non-experimental  studies  being  corducted.  However,  I  feel  that 
our  area  is  probably  more  reactionary  in  switching  to  this  type 
of  methodology  than  otber  areas  in  Education  because  we  more  than 
many  other  scholars  have  our  roots  in  the  observable, 
quantifiable  phenomena  so  popular  with  behaviorists.  However,  we 
need  tw  develop  ways  of  bringing  naturalistic  methods  to  bear  on 
research  questions  of  interest  to  xis,  and  especially  to  develop 
techniques  in  which  qualitative  and  quantitative  methodologies 
work  together  rather  than  against  each  other  in  the  gathering  of 
data. 
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Publication  of  Results, 

Once  again,  so  much  has  been  said  about  how  to  get  research 
published  that  I  will  be  brief  to  avoid  redundancy.  There  are,  of 
course,   a  few,  obvious,  general  rules.  Following  these  by  no 
means  guarantees  publication.  But  failing  to  follow  them  does 
guarantee  that  the  paper  will  not  be  published. 

First,   make  sure  that  you  follow  the  style  manual  specified 
in  the  journal's  "Guidelines  for  authors".   Even  established 
scholars  often  fail  to  do  this,  and  editors  find  it  most 
irritating. 

Second,  make  sure  that  the  topic  and  type  of  paper  are 
suitable  to  the  journal.  You  would  be  surprized  if  you  knew  how 
many  manuscripts  submitted  to  ECTJ  are  about  topics  that  have 
nothing  to  do  with  Educational  Technology,  however  broadly  you 
define  it.  Also,   send  scholarly  papers  to  scholarly  journals  and 
less  scholarly  ones  to  journals  that  publish  non-scholarly 
articles.  I  reject  many  good  papers  because  they  are  not 
scholarly.   Often  these  end  up  in  other  journals,   as  they  should. 
But  sometimes  authors  are  discouraged  by  a  rejection  and  do  not 
send  their  papers  to  a  second,  more  suitable,  journal.  This  means 
that  a  good  article  that  has  something  to  say  never  docs  get  into 
press,   and  we  are  all  the  poorer  tui.  it. 

Mako  sure  that  you  meet  all  of  the  journal's  technical 
requirements.  If  they  ask  for  four  copies,   send  four  copies,  if 
it  is  to  be  typed  on  8  1/2  by  11  paper,  type  it  that  way.  Never 
send  little  notes  to  editors  in  which  you  explain  why  you  did  not 
follow  the  technical  or  stylistic  requirements  set  out  by  the 
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j  ournal . 

The  last  matter  is  of  more  substance,  and  in  a  sense 
recapitulates  a  lot  of  what  has  b^en  said  in  this  paper.  Make 
sure  that  what  you  are  reporting  or  writing  about  will  be  of 
interest  to  the  readers  of  the  journal,  and  will  be  respected  as 
sound  scholarship.  This  has  ^.'ements  that  concern  both  the 

question  that  you  write  about  and  your  methodology. 

As  far  as  the  first  point  is  concerned,  you  should  pick 
research  topics  that  contributes  to  current  knowldedge,  not  to 
something  that  ceased  to  be  of  interest  and  importance  years  ago. 
Clearly,  media  comparisons  are  no  longer  vorth  publr'^hmg,  nor 
are  a  number  of  other  topics,  in  order  to  meet  this  requirement, 
you  must  keep  up  with  wHat  is  going  on  in  the  field.  All  of  us  who 
supervise  graduate  students  have  had  uo  deal  with  the  student  v;ho 
is  terribly  excited  about  a  particular  research  question  or 
aspect  of  theory,  not  realizing  that  the  questio;i  has  already 
been  answered,  or  that  the  piece  of  theory  belongs  to  a  body  of 
knowledge  that  is  no  longer  considered  to  be  valid  or  valuable. 
It  is  sometimes  hard  to  persuade  such  students  that  their 
proposed  study  has  no  value,  and  if  completed,  will  contribute 
nothing  and  will  cerrainly  not  be  published.  So,  stay  current  and 
read  as  much  as  you  can. 

The  same  applies  to  your  methodology*  Do  not  use  designs 
that  have  been  superseded  by  more  sophisticated  and  robust  ones. 
And  do  not  use  techniques  of  analysis  that  are  no  longer 
considered  to  be  acceptable.  A  frequent  mistake,  lor  example,  is 
to  use  multiple  t-tests  instead  of  range  tests  when  w  significant 
difference  has  been  found  by  analysis  of  variance  with  more  than 
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two  groups*  Similarly,  do  not  use  parametric  tests  on  ordinal 
data.  That  is  another  frequent  flaw  in  manuscripts  that  I  see. 
There  are  a  number  of  these  pitfalls,  and  you  snould  be  vigilant 
and  knowledgeable  enough  to  avoid  them. 

You  must  also  make  sure  that  you  have  something  of 
consequence  to  say.  Your  ideas  may  be  current  and  the  methodology 
impeccable.  But  if  the  results  of  your  empirical  study,  or  the 
arguments  you  make  in  a  position  paper  leave  the  reader  with  a 
"So  what?"  feeling,  then  you  have  not  really  presented  any^-hing 
that  is  worth  publishing.   (After  reviewing  one  such  study,  an 
ECTJ  reviewer  wrote,  "What  a  waste  of  subjects!"    To  me,  that 
says  it  all.) 

Finally,  a  publishable  manuscript  has  to  have  an  internal 
logic  to  it.  By  this,  I  mean  that  the  hypotheses  of  an 
experimental  study  must  be  clearly  derived  from  the  literature 
review;  that  the  design  must  allow  one  to  test  the  hypotheses; 
that  the  techniques  used  to  analyze  the  data  must  be  appropriate 
to  the  design;   and  that  the  conclusions  must  follow  from  the 
results.  There  is  nothing  worse  than  hypotheses  that  appear  out 
of  the  blue,  apparently  at  the  whim  of  the  author,  except  perhaps 
for  conclusions  that  are  equally  unattached  to  anything  that  has 
preceded  them.  The  same  spirit  should  also  be  present  in  reports 
of  non-experimental  research.  The  arguments  should  flow  well  and 
the  points  should  follow  one  another  with  an  obvious  logic. 

Conclusion 

In  conclusion  let  me  just  remark  on  the  impossibility  of 
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speculating  with  any  accuracy  about  "future  trends",  whether  they 
be  in  Physics,   Literature  or  Education.  One  is  tempted  to  take 
liberties,  as  I  believe  Frank  Ogden  did  recently  (Ogden,  1985) 
when  he  predicted  that,   if  currenu  trends  in  "high  tech." 
continue,  people  will  marry  robots.  I  have  tried  not  to  take  such 
liberties,  but  rather  reflect  upon  what  I  see  beginning  to  happen 
in  research  in  our  field  and  in  kindred  areas.  I  believe  that  the 
research  questions  that  I  have  suggested  we  need  to  answer,  and  the 
methods  we  need  to  develop  and  use  to  answer  them,  do  anticipate 
quite  accurately  directions  in  which  the  field  will  move.  And  I 
hope  that  the  simple  suggestions  for  preparing  publishable 
manuscripts  will  be  of  some  assistance  in  getting  answers  to  our 
research  questions  into  ■:he  literature  for  all  to  share. 
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Abstract 


The  theory  oi  person^environment  fit  predicts  unhealthy  strain  caused 
by  a  mismatch  between  factors  external  to  the  individual  and  those 
that  are  internal.     In  the  study  reported  here,  the  theory  of  person- 
environment  fit  was  applied  to  assess  student  nell-being  in  a 
university  conputer  room.  A  qualitative  approach  was  chosen  for  this 
study  and  a  conceptual  frameHork  was  constructed  using  Miles  and 
Huberman's  technique  (1984).    A  script  of  questions  and  probes  was 
prepared  from  the  conceptual  framework.    Twelve  volunteers  from  a 
computer  literacy  course  were  Interviewed.    Both  objective  and 
subjective  data  about  physical  and  psychosocial  stressors  were 
obtained.    Some  insights  into  learner-environment  fit  are  already 
available,  although  the  results  reported  here  must  be  regarded  as 
prelininary.    Early  data  cuts  suggest  educational  computing  tasks, 
while  loss  frequent  and  of  shorter  duration,  may  be  more  inter'"-  than 
pink  collar  ^DT  work.    Denial  or  repression  may  have  been  a  part  of 
tiie  «ludent  view  in  accepting  complexity.  These  defence  mechanisms  may 
also  indicate  a  learner  role  effect  which  explains  student  reactions 
to  visual  and  musculo-skeletal  stressors.    Better  understanding  of 
learner-environment  relations  is  being  developed  through  monitoring 
interventions  such  as  teaching  students  how  to  reduce  conputer  stress. 
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LMrntr-EnvironSffnt  Fit: 

University  Students  in  a  Co«put«r  Roou 

Rasearch  on  human  behavior  in  work  situations  has  generated  a 
theory  describing  the  relationsi^ip  of  people  and  their  surroundings 
(Harrison,  1978;  Kasl,  1978,  p.  33-35;  Kulka,  1979).    The  theory  of 
person-environeent  fit  predicts  unhealthy  strain  caused  by  a  mismatch 
between  factors  external  to  the  individual  and  those  that  are 
internal.    Stressors  say  be  physical  or  psychosocial.    Each  can 
function  objectively  or  subjectively,  operating  independently  or 
dependently  of  the  person's  perceptions  as  shown  in  Figure  i. 


ENVIRONHENT 


Physic^  PfychoflociAl  Phyiicai  Pfyehotocial 

Objtctivt  SubjKtivff  Objtctjvt  Stibjtctivt  Ofcjtctivt  Subj«ctivt  Objtctiv^^S^ 


EiSyCS  I*  Oiagrae  of  person-environment  fit  components. 

The  person-environment  fit  theory  is  advocated  for  the  study  of 
Visual  Display  Terminal  <VOT)  work  (National  Research  Council,  1983, 
p.  173-193).    The  goal  in  that  instance  is  improving  the  congruence 
between  human  characteristics  and  the  computerized  workplace. 
Unhealthy  stress  is  explained  as  the  result  of  unsuitable 
environmental  conditions  created  by  the  rapid  implementation  of  new 
information  technologies.    In  the  study  reported  here,  the  theory  of 
person-environe«nt  fit  was  applied  to  an  assessment  of  student  well- 
being  in  a  university  computer  room;  towards  developing  better 
understanjing  of  learner-environment  relations  in  general. 

Two  separate  site  analysis  studies  proceeded  the  investigation 
(Yeaman,  1983;  1985).    They  were  rational  in  nature  in  that  they 
compared  educational  computing  facilities  with  a  checklist  synthesized 
from  standards  and  guidelines  for  VOT  work.  Several  physical, 
objective  aspects  of  the  environment  appeared  inadequate  for  the 
students'  range  of  physiological  characteristics.    The  checklist 
identified  lack  of  adjustment  in  keyboards  and  screens;  inappropriate 
chairs,  footrests,  desk  height,  leg  room  and  keyboard  height: 
reflective  glare  from  screen  and  keyboard;  and  direct  glare  from 
bright  lights  and  windows  in  the  field  of  view.  Objectively 
established  psychosocial  stressors  were  the  intrusive  sounds  of  voices 
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and  printers  and  the  lack  visual  privacy.  Based  on  application  oi 
that  checklist  and  in^formal  observitions  of  students,  recommendations 
were  aade  for  improving  microcomputer  learning  conditions  in  both 


Student  impressions  had  not  been  assessed  and  the  strength  of  the 
student-environment  relationship  Mas  not  known.    An  obvious  difference 
between  academic  and  workplace  computing  is  the  shorter  exposure  time 
of  learners.    Therefore,  it  was  expmcted  that  there  would  be  less 
objective  physical  and  psyc'^osocial  stress  and  the  stressors  would  be 
assigned  weaker  subjective  percsptions;  that  the  affect  of  deficient 
computing  environments  upon  students  would  be  less  than  upon  workers. 


Due  to  the  complexity  of  the  Issues,  a  qualitative  appr  jich  was 
chosen  for  this  study.    Strong  arguments  have  been  made  for  this  mode 
of  investigative  thought  in  the  field  of  educational  communication  and 
technology    (Kerr  &  Taylor,  1985).  A  reductionist  and  intrusive 
measure  of  stress  such  as  before  and  after  levels  of  catecholamine  and 
adrenocortical  excretion  would  be  lif"?ted  to  only  producing  data  on 
the  objective  person  physical  dimension.    Quantitative  paper  and 
pencil  self -report  scales  were  ruled  out  due  to  the  importance  of 
sample  size  in  epidemiological  surveys  on  VDT  work(Helander, 
Billingsley  &  Schurick,  19B4) . 

Following  informal  observations  of  several  academic  computing 
facilities,  a  conceptual  framework  was  constructed  using  liile^  and 
Huberean's  technique  (19B4),  see  Figure  2.    It  particularly  reflects 
the  learner-environment  relationship  in  delineating  components  for 
analysis  that  are  both  objective  and  subjective.    The  dimensions  were 
corroborated  by  the  Hisconsin-NIOSH  industrial  study  conducted  by 
Sauter,  Gottlieb,  Jones,  Dodson  Se  Rohrer  (19B3). 


aicrocaaputtr  ttudtnt 

l»4rninQ  tnvirofKwnt         »  phyiiological  vituai  ftrtts 


settings. 


Hethod 


ElSyCS        Dimensions  of  the  conceptual  framework. 
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A  script  of  questions  and  probes  was  prepared  frcm  the  conceptual 
framework.    The  script  was  used  to  conduct  structured  interviews  with 
university  students  using  the  ni crocomputers  in  a  single  computer 
room.    The  students  reported  on  the  dimensions  illustrated  in  Figure  2. 

Because  the  human  factors  research  literature  Indicates  three 
predominant  symptoms  of  VDT  stress — visual,  musculo-skeletal  and 
psychological  (National  Institute  for  Occupational  Safety  and  Health, 
1981;  Sauter  et  al.,  1983)— they  were  the  focal  point  for  evaluation. 
Both  objective  and  subjective  data  about  stressors  were  obtained. 
Objective  data  included  such  information  as  height,  weight,  corrective 
eyewear,  previous  computing  experience  and  time  of  day  each  student 
usually  went  to  the  coaputer  room.    Subjective  data,  based  on  student 
experiences  in  the  computier  room,  included  such  information  as 
feelings  of  visual  and  physical  discomfort  and  psychological  aspects 
such  as  the  degree  of  compleMity  perceived  in  completing  assignments. 
Questions  about  experiences  in  the  computer  room  preceeded  potentially 
sensitizing  questions  about  feelings  of  well-being.    Regarding  the 
acceptability  of  verbal  reports  as  data  (Nisbett  Se  Wilson,  1977), 
cautions  against  confabulation  included  the  acceptance  of  verbose 
responses  rather  than  offering  the  repondents  a  fixed  set  of 
alternative  answers  (Ericsson  tc  Simon,  19S0;. 

Twelve  participants  were  interviewed.  They  were  all  enrolled  in  a 
computer  literacy  course  and  volunteered  to  be  in  the  study  m 
exchange  for  an  extra  credit  incentive  offered  by  their  instructor. 
There  were  five  women  and  two  men  from  the  afternoon  section  and  two 
women  and  three  men  from  the  evening  section  of  the  class.  They 
varied  in  age  from  19  to  35  with  10  students  between  19  and  22.  None 
of  the  interviewees  were  previously  aquainted  with  the  investigator. 

The  computer  room  used  by  the  students  in  this  study  was 
originally  a  small  classroom  and  it  had  undergone  renovation  to  become 
a  place  for  academic  computing.    Briefly^  its  features  were  a  single 
door,  two  rows  of  suspended  fluorescent  lights  and  two  unshaded 
windows.    Power  strips  had  been  installed  and  a  black  workbench 
erected  against  three  iialls.    At  the  time  of  this  investigation,  the 
workbench  supported  three  Apple  II-*-  and  two  Apple  He  microcomputers, 
two  Okidata  dot  matrix  orinters.  a  Televideo  925,  a  Lear  Siegler  ADM-3WU^ 
a  DecMriter,  a  manual  typewriter  and  an  electric  typewriter. 

Individual  students  working  on  ^^omputer  literacy  assignments  were 
the  primary  visitors  to  the  facility  and  the  subjects  of  this  study. 
Length  of  use  varied  from  20  minutes  to  8  hou^s  with  most  students 
word  processing  papers  or  writing  programs.     They  used  Magic  Mindow 
for  word  processing,  Apple  BASIC  for  programming  and  VisiCalc  for 
spreadsheet  exercises.    Students  from  programming  classes  were  the 
next  largest  group  of  people  to  be  found  in  the  room.    Other  people 
occasionally  present  werp  university  clerical  workers  and  professors. 
Adults  and  children  from  the  community  came  in  on  the  evenings  and 
weekends  more  than  any  other  time.    The  handful  of  hacker-like 
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students  on  the  ca«pus  preferrec^  to  be  with  the  Commodore  64  in  the 
physics  lab.    That  was  the  place  Apple  II  software  was  kept  and  three 
were  employed  in  checking  it  out  a  few  hours  each  day.    There  was  only 
one  hacker*-like  student  frequenting  the  computer  room  at  the  time  of 
the  investigation.    Unable  to  take  the  Pascal  class  due  to  a  schedule 
conflict,  he  taught  hi«self  and  then  proceeded  to  create  a  russian 
typing  tutor  so  he  could  inaster  the  Cyrillic  keyboard. 


Visual  Stress 
Objecti^ve 

Three  of  the  Apple  IH  microcomputers  had  Amdek  color  monitors 
which  made  text  appear  fuzzy  due  to  horizontal  smear.    This  was 
particularly  apparent  when  in  the  80  column  mode.    Screen  angle  was 
not  adjustable.    Brightness,  contrast  and  color  controls  were 
concealed  behind  a  door  imaediately  below  the  screen.    The  fourth 
Apple  11-*-  had  a  an  older  model  Heath  Zenith  green  screen  with  black 
level  and  contrast  knobs  on  the  front.    The  image  on  this  screen 
intermittently  rippled  and  blurred.    Sometimes  a  waving  grid  pattern 
appeared  too. 

The  Apple  green  screens  on  the  Apple  He  microcomputers  presented 
alphanumeric  characters  considerably  sharper.    They  were  adjustable 
for  tilt  by  pushing  on  the  top  or  bottom  of  the  screen.  Brightness  was 
controlled  by  a  knob  on  the  side.    The  contrast  knob  was  on  the  bact^ 
and  not  readily  accessible. 

All  the  screens  reflected  the  overhead  lights  and  created 
reflective  glare.    Two  screens  reflected  extreme  glare  from  the 
windows:    This  was  particularly  strong  due  to  snow  outside  four  months 
of  the  year.    At  night  the  windows  acted  as  mirrors,  reflecting  the 
fluorescent  lights.    There  were  no  curtains  or  shades.    Keycaps  and 
chrome  security  locks  created  highly  contrasting  reflective  glare  at 
every  station. 

No  one  was  instructed  in  adjusting  the  position  of  screens  to 
reduce  reflective  glare  and  increase  visual  comfort  and  efficiency. 
Nor  was  anyone  told  about  adjusting  screen  brightness  and  contrast  to 
suit  personal  preference.    There  were  no  copyholders  and  drafts  of 
papers  and  programs  were  usually  laid  flat — which  induced  off-angle 
reading. 

When  working  with  the  microcomputers,  the  students  faced  the  wi^ll 
at  all  times:    there  was  nowhere  to  look  away  and  focus  on  distant 
objects  for  vision  relief.  Five  of  the  students  interviewed  wore 
glasses  and  another  five  wore  contact  lenses.    All  of  those  10 
students  were  myopic.    In  addition  to  being  nearsighted,  two  said  they 
had  correction  for  astigmatism.    None  of  the  students  reported  having 
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uncorrected  visual  problems.    None  were  taking  tranquilizers,  a 
medication  which  can  produce  visr^l  fatigue  symptoms  through  changes 
in  oculomotor  functions. 

Subigcti ye 

Eight  students  reported  visual  discomfort  such  as  red,  bloodshot, 
tired  eyes.  Four  students  experienced  visual  discomfort  within  the 
first  hour  of  microcomputer  use  or  less.    Three  more  had  eye  problems 
within  two  hours  or  less. 

Only  one  student  thought  the  screens  too  bright  or  too  reflective 
but  other  students  added  qualifying  statements:    "Unless  it  is  a  color 
screen  and  that  bothers  me."    "The  older  models."    "Not  the  screen — 
sometimes  the  light  coming  through  the  windows  will  cause  glare  on  the 
screen. " 

Ten  students  never  adjusted  screens  for  tilt,,  contrast  or 
brightness.    One  adjusted  tilt,  "To  see  the  bottom  of  the  page." 
One  adjusted  contrast,  "To  make  it  easier  to  look  at."    Nearly  all 
students  v«ere  vague  about  the  location  of  any  accessible  screen 
controls.    There  was  confusion  over  there  function  and  sometimes 
denial  of  their  existence.    One  student  mentioned  switching  to  a  40 
character  line  with  bigger  letters  to  make  the  screen  easier  to  read 
when  using  the  word  processor. 

Gender  differences  became  apparent  when  the  students  were  asked 
about  how  reading  from  the  screen  felt.    Men  gave  short    replies  such 
as  "Pretty  good."  "Okay."  and  "Very  comfortable  but  my  eyes  get 
tired."  "    Women  replied:  "Sometimes  the  words  are  blurry."    "I  have 
to  read  things  twice.    After  a  while  they  ran  together — sort  of 
blurry."    "After  a  while  it  becomes  fuzzy  to  look  at.*'  "There  are 
different  types  of  screens  and  sometimes  I  have  to  strain  to  read  the 
dots."  "Would  like  a  bigger  screen  so  i  could  put  more  on  a  line."  "If 
proofing,  single  spacing  is  difficult  to  read.  I  lose  part  of  the  text 
as  Tm  scrolling  along — it's  frustrating." 

Analysis 

The  short  time  for  the  onset  of  eyestrain  is  anomalous.  In 
comparison,  a  survey  of  daily  VDT  users  in  a  large  Swedish  insurance 
company  resulted  in  557.  complaints  of  optical  discomfort  (Ericsson 
Information  Systems  AB,  1983,  p.  63).    Contrary  to  expectations  these 
data  suggest  educational  computing  tasks,  while  less  frequent  and  of 
shorter  duration,  nay  be  more  intense  than  the  pink  collar  VDT  work 
which  is  the  usual  object  of  investigation.    The  unsatisfactory 
quality  of  some  of  the  screens  for  reading  text  may  also  be  a 
contributing  agent. 
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Student  responses  were  occasionally  self-contradictory.  Instead 
o-f  saying  t'ley  personally  experienced  a  problem,  descriptive  evidence 
was  provided  which  indicated  a  problem.    The  male  responses  were 
unusually  brief  in  these  situations  but  one  succinctly  illustrates  the 
paradox:     "Very  comfortable  but  my  eyes  get  tired." 

i3y§£yi9li!iii§tiL  stress 
Objective 

Students  varied  in  weight  and  in  height:    from  103  to  220  pounds 
and  rrom  4  feet  11.5  inches  to  6  feet  3  inches.    These  were 
accommodated  by  one  size  fits  all  microcomputer  stations.  Some  of  the 
microcomputers  were  positioned  right  above  the  steel  legs  of  the 
workbench  that  supports  the  microcomputers  and  students  sat  with 
restricted  knee  and  leg  movement.  A  general  indication  of  insufficient 
leg  space  was  the  scuff  marks  around  the  room  where  the  wall  had  been 
kicked  by  students  trying  to  stretch  their  legs  out.    The  Apple  II 
home  row  was  30.5  to  31  inches  abov      he  floor.  This  keyboard  height 
caused  many  students  to  sharply  bene    heir  elbows  and  wrists  and  is 
higher  than  any  trade  union  guideline  for  workstation  design,  see 
Ericsson  Information  Systems  AB,   (1983,  p.  146).    The  Apple  II 
keyboards  were  not  adjustable  or  (Roveable  in  any  way.    No  footrests 
were  available  for  shorter  students.    The  chairs  had  arms  attached  and 
were  not  at  all  adjustable. 

Subjective 

On  the  subjective  level,  8  of  the  12  reported  at  least  some 
postural  discomfort  in  either  neck,  hand,  wrist,  fingers,  shoulders, 
back  or  a  combination  of  locations.  However  most  apparently  attributed 
this  to  what  th&y  were  doing  not,  to  the  furniture.    For  example,  only 
two  people  said  the  chairs  were  uncomfortable.  Complaints  of  bruised 
knees  were  made  by  one  man  and  by  one  woman  in  reference  to  the  steel 
support  legs.    Without  prompting,  three  students  commented  on  the  lack 
of  copyholders — which  they  had  learned  to  use  in  high  school  typing 
classes — and  said  they  propped  up  pages  with  a  book. 

Anal^ysi  5 

There  was  some  physical  misfit  between  the  objective  person  and 
the  objective  environment  because  one  size  does  not  fit  all.    This  is 
particularly  important  to  consider  when  assessing  microcomputer 
learning  stations  as  the  equipment  severely  constrains  posture,  as 
opposed  to  working  with  print  materials  that  can  be  moved  around.  In 
reference  to  the  steel  struts  supporting  the  work  surface,  the  poor 
positioning  of  the  microcomputers  made  matters  worse.    They  could  not 
be  easily  moved  as  the  security  devices  were  attached  with  permanent 
glue.    However,  using  those  particular  microcomputer  stations  does 
contain  an  element  of  minor  hazard.     It  is  revealing  that  the 
students'  subjective  views  seldom  identified  physical  aspects  of  the 
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environment  for  improvement.    With  the  exception  of  the  students  with 
bruised  knees,  they  took  responsibility  for  any  muscul o-skel etal 
discomfort  experienced  upon  themselves. 

Psychol ogical  Stress 

Ob_iecti_VB 

NeN  technology  is  often  viewed  as  too  complicated  and  difficult 
to  comprehend.     In  this  situation,  the  learners  were  required  to 
master  small  details  to  make  computing  work  for  them.    These  fine 
points  were  often  limitations  imposed  by  the  software  and  hardware  and 
irrelevant  to  the  larger  learning  intended. 

Subiecti.ve 

During  their  interviews  11  of  the  students  never  directly 
admitted  that  the  computers  and  the  computing    tasks  might  be  too 
complex.    Nevertheless,  a  poor  person-environment  fit  is  likely  since 
nine  reported  incidents  when  they  could  tell  that  other  students  were 
upset  or  annoyed.    Students  were  unable  to  make  their  programs  run. 
They  lost  termpapers  and  programs  in  the  microcomputers  and  were 
unable  to  save  or  retrieve  work  which  took  hours  to  type  in.  They 
reacted  by  muttering,  exclaiming  out  loud,  banging  a  fist  on  the  table 
and  crumpling  or  tearing  up  their  paper  print  out. 


Denial  or  repression  may  have  been  a  part  of  the  student  view  in 
accepting  complexity.  These  defence  mechanisms  may  also  indicate  a 
learner  role  effect  which  would  aid  in  explaining  the  student 
reactions  to  visual  and  musculo-skeletal  stressors.    Denial  or 
repression  are  also  suggested  by  the  National  Research  Council 
(1983,  p.  177)  to  account  for  a  sub jecti ve-objective  fit  relationship 
"weakened  by  a  person's  subjective  distortions.'* 

Six  students  took  responsibility  for  any  problems  on  themselves 
with  stateipents  such  as:  "If  you  have  the  time  to  put  in — basically — 
no,  they're  not  too  complex."     "You  must  take  time  to  get  acquainted. 
You  just  can't  sit  down  and  do  it."    "I'm  not  a  brain  when  it  comes  to 
computers.     It's  a  basic  computing  class — could  be  more  complicated." 
A  student  moderated  his  response  by  identifying  complexity  brought 
about  by  technological  transition:     "I'm  used  to  Radio  Shack  computers 
so  I  find  it  hard  sometimes." 

Only  one  student  said  ye?,  that  the  computers  and  computing  tasks 
were  too  complex.     She  placed  the  responsibility  outside  of  herself  by 
identifying  subtle  differences  between  operating  the  Apple  He  and 
Applp  11+  microcomputers  and  the  inconsistency  of  software  commands 
performing  the  same  function. 


Analysi^s 
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Discussion 


Student  learning  behavior  and  Nell-being  were  evaluatbd  on  the 
basis  of  three  criteria.    These  were  the  symptoms  of  VDT  stress 
usually  found  in  the  work  place:    visual  stress,  oiusculo-skel etal 
stress  and  psychological  stress.    Environmental  contributors  to  these 
forms  of  computer  stress  were  assessed  by  two  techniques.    The  first 
was  objective  observation  such  as  measuring  the  height  of  keyboards 
above  the  floor.    The    second  was  rational  application  of  established 
knowledge  such  as  comparing  that  measurement  with  ergonomic 
recoflimenddtions  in  the  human  factors  literature.    Relevant  infornation 
from  the  personalogi cal  dimension  was  collected  through  interviews. 
For  instance,  self  reports  of  physical  measurements  showed  the 
facility  rits  used  by  people  with  a  Hide  range  of  characteristics. 
Responses  to  questions  and  probes  regarding  specific  stress  issues  and 
instances  were  collected.    Analysis  has  begun  and  the  results  of 
several  cuts  of  the  data  are  reported  here. 

How  computer  learning  experiences  are  viewed  by  students  is 
enigmatic  but  a  position  is  being  built.    There  is  real  evidence  of 
the  three  types  of  computer  stress:    student  computing  activities  may 
be  far  rr.ore  stressful  than  the  experience  of  computer  workers.  Unlike 
prof Bssic^^als,  the  students  have  high  pressure  to  perform,  low  control 
over  their  tasks,  less  autonomy  and  less  support  in  terms  of  efficient 
facilities.    All  three  areas  investigated  revealed  real  problems* 
Screens  with  sharply  visible  letters  and  numbers  were  not  often 
available  and  all  screens  had  reflective  glare.    The  learning  stations 
were  cramped  like  cockpits  in  military  airplanes.     The  hands  on  aspect 
of  computing  in  demanding  attention  to  trivia  was  an  impediment  to  the 
more  important,  conceptual  learning  intended.    Despite  providing 
supporting  evidence  for  each  from  of  computer  stress,  students  were 
seldom  critical.     In  favoring  satisfaction  over  dissatisfaction,  their 
statements  perhaps  reflected  more  what  students  would  ^rsier  to  think 
about  their  educational  experiences. 

Personal  characteristics  cause  individuals  to  reflect  person- 
environment  fit  differently  and  so  may  group  characteristics.  Workers 
with  more  creative,  less  repetitive  VDT  jobs  and  higher  socioeconomic 
status  voice  less  complaints  (Smith  et  al.,  1981,  p. 397).    This  white 
collar  group  aspect  might  provide  more  meaningful  comparisons  when 
examining  university  students:    a  learner  role  effect.  Student 
perceptions  may  be  muted  by  their  role:    perhaps  students  tend  to  be 
more  accepting  of  what  they  receive  becauses  instructors  are 
authorities.    The  learner  role  may  cause  students  to  believe  their 
learning  experiences  are  set  up  in  the  best  way  possible;  that 
situations  are  permanent  and  cannot  be  improved.  There  is  some  support 
in  the  person-environment  fit  literature  for  this.    A  study  o+  person- 
environment  fit  conducted  with  2,020  high  Sunool  students  by  French, 
Rodgers  t<  Cobb   (1974)  has  been  re-analyzed  by  Kulka  <1976j.  Poorer 
fit  was  reported  by  girls  than  boys,  which  also  lends  credence  to  the 
gender  differences  suggested  here.    Kulka  al^^o  identified  a  tendency 
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for  goodness  o-f  fit  to  increase  -for  older  cohorts.  University 
students  may  extend  that  and  cover  up  the  occurrence  o-f  misfit. 


Conclusi on 


Some  insights  into  learner-environment  fit  are  already  available, 
although  the  results  reported  here  must  be  regarded  as  preliminary. 
They  are  the  consequences  of  gathering  rich,  complex  data  not  yet 
fully  analyzed.    Better  understanding  is  being  developed  through 
ongoing  observations  and  informal  questioning  of  students.  Monitoring 
the  effects  of  intervention  such  as  teaching  students  how  to  reduce 
computer  stress  are  part  of  this. 

A  preventive  ergonomics  approach  is  taken  which  has  several 
components,   including  sensitization  to  the  issues  of  daily  work  with 
computers.    These  are  readily  demonstrable  as  the  computer  room  has 
not  been  modified  except  for  conversion  to  all  Apple  lie  microcomputer 
equipment  and  Appleworks  integrated  software.  Some  examples  follow: 
Students  are  shown  how  to  adjust  screens  to  natch  contrast  and 
brightness  to  their  personal  preference  and  how  to  tilt  screens  to 
minimize  reflective  glare.     They  are  encouraged  to  get  up,  walk  around 
and  engage  in  stretching  exercises  and  not  stay  rigid  in  one  seat. 
Frequent  rest  breaks  are  also  suggested. 

Psychosocial  dimensions  are  handled  in  a  similar  way.  Caporael 
identifies  two  important  components  in  learning  to  use  a  computer 
(1985,  p.  187-188):    trial  and  error  learning  and  computing  as  a 
social  activity.    Trial  and  error  learning  is  reduced  by  several 
strategies:    Students  are  encouraged  to  save  their  work  every  15 
(plnutes  at  least  to  avoid  accidental  loss.  Recipe  sheets  are  prepared 
with  instructional  design  principles  to  guide  beginners  through  the 
basic  steps  of  using  a  word  processor,  a  spreadsheet  and  a  database. 
New  strategies  have  also  been  adopted  to  reinforce  the  social  transfer 
of  information:    There  are  more  large  screen  defnonstrations  in  class 
time.    There  are  also  more  orientation  labs  as  part  of  class.  Students 
are  encouraged  to  work  together  on  class  projects  in  twos  or  threes. 
Above  all,  students  are  encouraged  to  take  responsibility  for  their 
learning  upon  themselves  and  practice  Ellis'  philosophy  (1978): 

I  feel  determined  to  strive  to  use  whatever  power  I  have  to 
change  the  unpleasant  stresses  of  life  that  I  can  change^,  to 
dislike  but  realistically  accept  those  that  I  cannot  change,  and 
to  have  the  wisdom  to  know  the  difference  between  the  two.   (p. 203). 

Ergonomic  recommendations  for  business  computing  facilities  have 
been  applied  towards  the  objective  assessment  of  microcomputer 
learning  environments  (Yeaman,  1983,  1985)  but  subjective  dimensions 
also  need  to  be  considered  in  research  on  educational  computing. 
Students'  reported  feelings  need  to  be  checked  against  what  they 
perceive  happening  to  other  students  and  contrasted  with  objective 
dimensions  of  the  conceptual  model,  shown  in  Figure  2,  through  direct 
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observation.      The  application  of  person-envircnment  -fit  may  be 
useful  in  developing  guidelines  for  the  ifliprovement  of  computer 
learning  facilities.    Just  as  computer  learning  experiences  should 
increase  student  well-being  and  learning  performance,  so  should  any 
learning  experiences,  and  further  analysis  of  learner-environment 
relations  may  provide  a  fruitful  theory  for  that  interaction. 
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85/1 A5 

BELLArlD,  J. 

INSTRUrTlOMAl    DF^  TON 

iiu  1  rxuo  1  A*/)i/\i.    f/Cj  ivjif 

OJ  /  c)  / 

BELLAMO.  il 

PACIMP 

ou/OD 

BELLAND,  J.C. 

'5U/  .ju 

BELLAND,  J.C. 

COMPUTER  GRAPHICS 

lj\Jf  JU 

BERRY  T 

BERRY.  T 

PFRSMA*  TOM 

/7i:n 

BOWIE,  M.M. 

LEARNiNG  STYl  FS 

O  U  /  t  J 

BOl/IE,  M.M. 

FILM 

BRATTON,  B. 

GRADUATE  EOUCATiON 

BRATTON,  B. 

CURRICULUM  CHAMGES 

8fi/4?1 

fr\J/   T  Cm  L 

CAMBRE,  M.A. 

SCRE^    DFS IGM 

8fi/?5 

f >U  /  «1  u 

CAMBRE,  M.A. 

COMPUTER  GRAPHICS 

8f  ''^fi 

OvJ  ,  sJU 

CANELOS,  J. 

INDIVIDUAL  DIFFERENCFS 

AIV'^A  f  AlJUf\la     l/Af  1  L.r\L.IV 

85/14fi 

CANE LOS,  J. 

PACINli 

o  o  /  o  □ 

CANELOS,  J. 

ENCODING 

Q«;/87 
OD/  o  / 

CANELOS,  J. 

COtlPUTFR-RASFD   INK  TRI  ITT  TON 

on  /  1'tU 

CANELOS.  J. 

1  FARNIMf^  ^TRATFRTF^ 

oD  /  ?j'f  o 

CANELOS,  J. 

INSTRUfTTOMAI    hFQ  TnM 

/n7 

CANELOS,  J. 

LEARNING  STRATEGIES 

lala/llMIIIIVJ       ,J     1  [\/\IL.V]Ala<J 

OD  f  fjHO 

CANELOS,  J. 

INSTRUCTIONAL  STRATEGY 

8^/65 

CANELOS,  J. 

NOTCTAKING 

85/843 

CARL,  D.L. 

ATTITUDES 

86/85 

CARL,  D.L. 

COflPUTERS 

86/35 

CARL,  R.R. 

ATTTTUDES 

86/85 
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rnMPllTF  R5 

86/85 

PNIITF      A  C 

TFLFTRAIMIIJG 

86/106 

PMIITF  A 
LilU  1  u  1    H  •  U  • 

86/106 

Q5/750 

1 FARMTMH  STYI  FS 

85/750 

nht  TOM      n  U 

ATTf  TIInF 

86/119 

riAi  TOM     n  iJ 

WRfTTMn       Tl  1  ^ 

nWl  1  LfiM         1  LLO 

R6/166 

DAI  TOM      n  Uf 

rrrtPAPV  nF  i  nnn 
err           ur  luuij 

HAI  TOM      n  W 

PnMPIITFR-RA^Fn  RF TNFnRTFflFMT 

85/101 

\J'Jf  X\JX 

HA!  TOM     n  \4 

RF  TNFnRPFMFNT 

85/101 

36/165 

HA!  THM     n  U 

ATTlTlinF 

86/153 

HA!  TOM     n  W 

flFniA  IITII  I7ATinM 

1  IE.  1^  1  M    U  1  I  L.  I  C  M  1  I  U  If 

86/153 

DFfiRArr  .1 

TFI  F  VT^  TflM 

1  uLu  T  1  7  1UI1 

85/125 

nrpDArr  i 

Ff  1  M  Turnov 

nilHT     1^  D 

TFI  F  VT^  TOM 

1  uLu  T I 3 lun 

8fi/185 

UiJU  1  9   fN  •  r  • 

AFFfI  f  ATrn  PARI  F  TFfFVTSTflM 

R6/lQf> 

niinT    V  D 
irJU  t  y  N  .  r  • 

AFFTI  TATrn  PARI  F  TFIFVI^TflM 

niinT    1^  D 

UUU  1  y   !\  •  r  • 

Tri  rvf^  TnM 

1  uLu  f  1<>  iUil 

86/195 

PAPTMH 

86/65 

hi/vro  F 

HOTrTAI^  TMH 

ivJ  \  u  1  nh  Lnu 

RS/848 

1 FARUTMH  QTDATrPfTQ 

R(^/84n 

n'/YFD  F 

rnMPllTF R-RA^^n  TMSTRHrTinN 

LrUI  ir  U  1  u  r\            wLI    llO  1  nULr  1  I  nil 

85/146 

nuvro  F 

TNnTVTnilAI  nTFFFRFMPF^ 

\J  J  f  X  f\J 

niiYFP  F 

FNPnnTMR 

nUYFR  F 

INSTRUCTIONAL  OFSIGH 

85/87 

nUYFR  F 

INSTRUCTIOHAL  STRATFRY 

86/65 

flEDIA  SELECTION 

86/210 

FF! T     ^  R 

HRAnilATF  FOIJfATIOM 

86/30? 

FFI T     ^  n 

MAMARFMFMT 

86/302 

rnoMAM    p  r 

rliKHAI*  »    la  •  L  • 

VTnFn 

f  1  UuU 

85/164 

rnnii  TTTOM 

Lrllun  I  1  I  KJn 

85/164 

r  U  J  N  U  1  1    L  •  1  • 

vf  nrn 

OJr  X  J  T 

rncfinT     P  T 

pnr^MTTTnu 

*3JfX  \J*T 

FDrMPIJ  M 

IMSTRllPTTOfJ 

RS/P70 

FRFMPM  f1 

TIKTRIirTinMAI  STRATFf^TF*^ 
III)  1  r\i/Lr  1  I'/Hnu   J  ir\niuvjiu^ 

85/193 

rpTfiPij  ri 

r  r\U  IILrll  1      M  • 

AIJALYTir  ARTI  TTY 

85/193 

FRFfJPN  f1 

r  r\Utl  Lrl  1  f     1  >  • 

ore r ADpu 

85/220 

nKTRIirTiriHAI    TFCMMni  nRY 

85/232 

TEACHER  SOCIALIZATION 

85/318 

rOMPIITFRS 

85/318 

Fl  FPTRnHir  MATI 

UUU  Vr  1  l\UII  l\j     t  IM  I  U 

86/220 

HARNART  P 

rnMPIITFR-RASFO  TNSTRlirTTOM 

VrKJf  ir  1/  1  U  i\    \Jf\  JUL/     I  ' «  J  1            1  I If 

86/230 

fiAPNART  P 

rOflPIITFR-RASFO   INSTRUCT  TOM 

86/336 

f^ARNART  P 

rnMPIITFR-RASFO   INSTRUCT  TOM 

LrUI  Ir  U  1  u  i\    u/O  ut^    I  no  1  r\uLr  1  I  ^in 

86/336 

PADNADT  P 

PnfiM  T T T  VP  MO M  T  TOR  T  MH 
Uwun  1 1 1  f  u  1  ium  I  1  Ur\  I  nu 

36/230 

p  irnnr    p  i 

PIIRRTPIII  IIM  PHAMCFS 

86/421 

GJFRDE.  C  L 

GRADUATE  EDUCATION 

86/421 

GOETZFRIEO,  L. 

MATHEMATICS 

85/252 

GOETZFRIED,  L. 

COflPUTER-ASSISTED  INSTRUCTIOH 

85/252 

GOTHBERfi,  H.fl. 

TIMF.  MANAGEMENT 

86/252 

'^'JTHBERG,  H.M. 

LIBRARY  MAtlAGEMEHT 

86/252 

GRARINGER,  R.  S. 

COMPUTER-GENERATED  TEXT 

86/271 

849  813 


AUTHOR'S  HAME 

DESCRIPTOR 

YR/PG 

GRABINGER,  R.S. 

TEXT  LAYOUT 

85/280 

GRABINGER,  R.S. 

TEXT  FORMAT 

86/271 

GREATHOUSE,  S. 

COMPUTERS 

86/85 

GREATHOUSE,  S. 

ATTITUDES 

86/85 

GRIBBLE,  M. 

TEACHER  SOCIALIZATION 

85/318 

GRIBBLE,  M. 

COMPUTERS 

35/318 

HALES,  R.L. 

MANAGEMENT 

86/302 

HALES.  R.H. 

GRADUATE  EDUCATION 

86/302 

HAMCLOSKY,  W.  V. 

TASK  ANALYSIS 

86/313 

HANCLOSKY,  W.V. 

ADVANCE  ORGANIZER 

86/313 

HANNAFIN,  M. 

COGNITIVE  MONITORING 

86/230 

HAMMAFIN,  M. 

COMPUTER-BASED  INSTRUCTION 

86/336 

HANNAFIN,  M. 

MATHEMATICS 

85/252 

HAMHAFIN,  M. 

COMPUTER- ASS  IS TED  INSTRUCTION 

85/252 

HAMUAFIN,  H. 

COMPUTER-BASED  INSTRUCTION 

86/230 

HANNAFIN,  M.J. 

ATTITUDE 

86/153 

HANNAFIN,  M.J. 

MEDIA  UTILIZATION 

86/153 

HANNAFIN,  M.J. 

COMPUTER-BASED  REINFORCEMENT 

85/101 

HANNAFIN,  M.J. 

ACHIEVEMENT 

85/101 

HART,  R.  A. 

MEDIA  ATTRIBUTES 

86/358 

HART,  R.A. 

SYNTACTIC  PLACEMENT 

85/332 

HART,  R.A. 

CONCEPT  LEARNING 

85/332 

HART.  R.A. 

VISUALIZATION 

86/358 

HO,  M.L. 

CURRICULUM  DIRECTORS 

85/372 

HQ.  n.L. 

TEACHING  INSTITUTIONS 

85/372 

HO,  M.L. 

COLLECTION  SCALES 

86/390 

HO,  M.L. 

MAPPING 

86/390 

HORTIN,  J. A. 

MEOIA  LIBRARIES 

86/410 

HORTIN,  J. A. 

PUZZLE  SOLVING 

85/386 

IIORTIN,  J. A. 

IMAGERY 

85/386 

HORTIN,  J. A. 

TEACHER/PRINCIPAL  ATI ITUDES 

86/410 

HOUSE,  J.D. 

GRADUATE  EDUCATION 

86/421 

H01J3E,  J.D. 

CURRICULUM  CHANGES 

86/421 

HURT,  J. A. 

ILLUSTRATIONS 

85/392 

HURT,  J. A. 

PROSE 

85/392 

JONASSEN  n.H. 

PERCEPTUAL/COGNITIVE  TASK 

86/451 

JONASSEN,  D.  H. 

SEARCH  TASK 

86/469 

JONASSEN,  D.H. 

LIST  VS.  FLOW  CHART 

86/469 

JONASSEN,  D.H. 

STATE  ANXIETY 

86/461 

JONASSEN,  D.H. 

COMPUTERPHOBIA 

86/461 

JONASSEN,  D.H. 

COMPUTER  DISPLAY 

86/451 

JONES,  P.E. 

INSTRUCTIONAL  TELEVISION 

86/478 

JONES,  P.E. 

RESEARCH 

86/478 

KING,  J.U. 

CASE  STUDY  METHODOLOGY 

85/418 

KING,  J.H. 

COMMUNICATION  PROGRAMS 

85/418 

KLOOK,  T 

PERSUASION 

85/750 

KLOOK,  T 

LEARNING  STYLES 

85/750 

KOETTING,  J.R. 

TEACHING  ANALYSIS 

85/437 

KOETTING,  J.R. 

VIDEO 

85/437 

LAMBERSKI,  R.J. 

NONCOMMERCIAL  FM  RADIO 

86/505 

LAMBERSKI,  R.J. 

TELEVISION 

86/195 

LAI1BERSKI,  R  ), 

AFFILIATED  CABLE  TELEVISION 

86/195 

LAMBERSKI,  R.J. 

RADIO 

86/505 
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LAMBERSKI,  R.J. 

TELEVISION 

86/185 

LAMBERSKI,  R.J. 

AFFILIATED  CABLE  TELEVISION 

86/185 

LAMBERSKI.  R.J. 

RADIO 

86/490 

LAMBERSKI.  R.J. 

NONCOMMERCIAL  FM  RADIO 

86/490 

LEIDMAH,  M.B. 

RADIO 

86/490 

LEIDMAN,  M.B. 

NONCOMMERCIAL  FM  RADIO 

86/505 

lEIDMAN,  H.B. 

RADIO 

86/505 

LEIDMAN, M.B. 

NONCOfWERCIAL  FM  RADIO 

86/490 

LOERTSCHER,  D. 

MAPPING 

85/390 

LOERTSHCER.  D. 

COLLECTION  SCALES 

86/390 

LYNCH,  B.E. 

SPATIAL  RELATIONSHIPS 

86/521 

LYNCH,  B.E. 

FILMIC  CODING 

86/521 

LYNESS,  A.L. 

INTERACTIVE  VIDEO 

35/462 

MATTHIAS,  M. 

COMPUTERS 

85/703 

MOLINA,  R.R. 

RESEARCH 

85/479 

MOLINA,  R.R. 

SPATIAL  VISUALIZATION 

85/479 

MOORE,  D.M. 

FIELD  DEPENDENCE/INDEPENDENCE 

85/485 

flOQRE,  D.M. 

IMAGERY 

85/485 

MORIM,  A. 

INSTRUCTIONAL  TECHNOLOGY 

85/499 

MORIN,  A. 

THEORY 

85/499 

MORRISON,  G.R. 

COMPUTER-MANAGED  INSTRUCTION 

36/530 

MORRISON,  G.R. 

REGRESSION  MODEL 

86/530 

MOSELY,  M.L. 

COMPUTERS 

86/620 

MOSELY.  M.L. 

MOTIVATION 

06/620 

MUFFOLETTO,  R. 

TEACHER  SOCIALIZATION 

85/318 

MUFFOLETTO,  R. 

COMPUTERS 

B5/318 

NICHOLS,  R. 

NOTETAKING 

85/848 

NICHOLS,  R. 

LEARNING  STRATEGIES 

85/848 

NISHIKAWA,  S.S. 

FEEDBACK 

85/530 

OLSON,  J.S. 

SPEECH 

35/558 

OLSON,  J.S. 

TECHNICAL  PRESENTATIONS 

85/558 

PEARSON,  M. 

LIST  VS.  FLOW  CHART 

85/469 

PEARSON,  M. 

SEARCH  TASK 

86/469 

PHILLIPS,  T.L. 

COMPUTER-BASED  INSTRUCTION 

86/336 

RAGAN,  T.J. 

INSTRUCTIONAL  DESIGN 

85/542 

RAG AN.  T.J. 

CAI  STRATEGIES 

86/542 

RANDALL,  J. P. 

EVALUATION 

86/552 

RANOALL,  J. P. 

MEDIA  SERVICES 

86/552 

REHN,  R.A. 

DOGMATISM 

85/557 

REHM,  R.A. 

INSTRUCTIONAL  METHODS 

85/557 

RIEBER,  L.  P. 

PROBLEM  SOLVING 

86/562 

RIERER,  L.P. 

EFFICACY  OF  LOGO 

36/562 

RIEBER,  L.P. 

COMPUTER-BASED  INSTRUCTION 

36/335 

RIGGS,  D.E. 

LIBRARY  MANAGEMENT 

86/252 

RIGGS,  D.E. 

TIME  MANAGEMENT 

86/252 

ROBINSON,  R.S. 

INTERACTIVE  TELEVISION 

85/623 

ROBINSON,  R.S. 

INTERACTIVE  CABLE  TELEVISION 

86/ 598 

ROSS,  S.M. 

COMPUTER-MANAGED  INSTRUCTION 

06/530 

ROSS,  S.M. 

REGRESSION  MODEL 

86/530 

R055ETT,  A. 

INSTRUCTIONAL  DESIGN 

85/612 

SALCEOO,  A.M. 

INSTRUCTIONAL  TELEVISION 

35/650 

SALISBURY,  D.F. 

COMPUTERS 

85/563 

SALISBURY,  D.F. 

DRILL  AND  PRACTICE 

85/663 
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SEIDMAN,  S.A. 

TEACHER  BURNOUT 

85/678 

SEIDMAN,  S.A. 

MEDIA  UTILIZATION 

85/678 

SEIDNER,  C.J. 

COMPUTER-BASED  INSTRUCTION 

85/889 

SEIDNER,  C.J. 

TASK  PERFORMANCE 

85/889 

SEYMOUR,  SA. 

COMPUTERS 

86/620 

SEYMOUR,  S.L. 

MOTIVATION 

86/620 

SHAW,  S. 

COMPUTERS 

85/703 

SHROCK,  S.A. 

COMPUTERS 

85/703 

SILVERSTEIN,  M.A. 

VIDEODISC  SYSTEM 

85/717 

SILVERSTEIN,  M.A. 

SOCIAL  INTERACTION 

85/717 

SIMONSON,  M.  R. 

f^UBLIMINAL  MESSAGES 

86/763 

SIflOHSOM,  M.R. 

LEARNING  STYLES 

85/750 

SIMONSON,  M.R. 

PERSUASION 

86/763 

SIMONSON,  M.R. 

PERSUASION 

85/750 

SMITH,  P. 

SIMULATION 

36/656 

SMITH,  P. 

COMPUTER-BASED  INSTRUCTION 

86/656 

SMITH,  P.L. 

PROCESSING 

86/635 

SMITH,  P.L. 

CUEING 

86/635 

SMITH,  P.L. 

TEXT  DESIGN 

85/783 

STACY,  N.O. 

COMPUTERS 

86/620 

STEVENSON,  R.B. 

COMPUTER  LITERACY 

85/797 

STEVENSON,  R.B. 

EMPOWERED  LEARNING 

85/797 

STONE,  R. 

PERSUASION 

85/750 

STONE,  R. 

LEARNING  STYLES 

85/750 

STORM,  S.R. 

TELEVISION 

85/813 

STORM,  S.R. 

CHILDREN 

85/813 

STORY,  N.O. 

MOTIVATION 

86/620 

SULLIVAN,  H.J. 

MOTIVATION 

86/6C0 

SULLIVAN,  H.J. 

COMPUTERS 

86/620 

TAYLOR,  W. 

ENCODING 

85/87 

TAYLOR,  W. 

INSTRUCTIONAL  STRATEGY 

86/65 

TAYLOR,  W. 

INSTRUCTIONAL  DESIGN 

85/87 

TAYLOR,  W. 

NOTETAKING 

85/848 

TAYLOR,  W. 

PACING 

86/65 

TAYLOR,  W. 

INDIVIDUAL  DIFFERENCES 

85/146 

TAYLOR,  U. 

LEARNING  STRATEGIES 

85/848 

TAYLOR,  W. 

COMPUTER-BASED  INSTRUCTION 

85/146 

TIENE,  D. 

TELEVISION 

86/745 

TIENE,  D. 

INSTRUCTIONAL  TELEVISOIN 

86/721 

TIENE,  D. 

PUBLIC  TELEVISION 

86/  721 

TILLMAN,  M.H. 

ELECTRONIC  MAIL 

86/220 

TORARDI,  fl.M. 

COMPUTER  LITERACY  ASSESSMENT 

85/860 

TOIJGER,  H.E. 

TASK  PERFORMANCE 

85/889 

TOUGER,  H.E. 

COMPUTER-BASED  INSTRUCTION 

85/889 

TREIMER,  M. 

PERSUASION 

86/763 

TREIMER,  M. 

'    -ciiINAL  MESSAGES 

86/763 

VENSEL,  C. 

COMPUTERS 

85/703 

WATSON,  J.F. 

WRITING  SKILLS 

86/166 

WATSON,  J.F. 

WORD  PROCESSING 

86/166 

WEDMAN,  J.  F. 

COMPUTER  INSERVICE 

86/782 

WEDMAN.  J.F. 

INSERVICE  DESIGN 

86/782 

WELLIVER,  P.  W. 

GRADUATE  STUDENTS 

86/797 

l/EST,  P.C. 

INTERACTIVE  CABLE  TELEVISION 

86/593 
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WINN,  W.  RESEARCH  TRENDS  86/801 
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YEAMEN,  A.  R.  PERSON-ENVIRONMENT  FIT  86/833 
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ACEVEDO,  C. 

PICTORIAL  ELABORATION 

30/1 

ACEVEDO,  C. 

BILINGUAL  LEARNERS 

80/1 

ACEVEOO,  C. 

COGNITIVE  EFFECT 

80/1 

ALTER,  11. 

SPECIAL  EDUCATION 

32/105 

ALTER,  11. 

EVALUATION 

32/105 

ALTER,  M. 

INSTRUCTIONAL  SYSTEMS 

82/105 

ALTSCIIDLD,  J. 

VISUALIZED  INSTRUCTION 

82/183 

ALTSCHULD,  J. 

LEARNING 

32/183 

ALTSCHULD,  J. 

ENCODING 

83/125 

ALTSCHULD,  J. 

INF0RI1ATI0N  CUEING 

83/125 

AIIDER50II,  C. 

COMMUNICATION 

80/35 

AliJERSON.  C. 

MEDIA  COMPETENCY 

80/35 

AIIGERT,  J. 

PICTORIAL  RESEARCH 

80/125 

ANGERT,  J. 

META-ANALYTIC 

30/125 

AIIGERT,  J.F. 

RESEARCH 

79/1 

ANGERT,  J.F. 

RESEARCH 

32/144 

AHGLIN,  G.J. 

APTITUDE 

81/1 

AIIGLIII,  G.J. 

ATI 

ni/1 

ANGLIII,  J.B. 

APTITUDE 

81/1 

AIIGLIN,  J.B. 

ATI 

81/1 

ARilOLD,  T.C. 

BEHAVIORAL  OBJECTIVES 

32/15 

ARNOLD,  T.C. 

INSTRUCTIONAL  EFFECT 

82/15 

ARNOLD,  T.C. 

STIMULUS-EXPLICITNESS 

32/15 

ATANG,  C.I. 

COGNITIVE  STYLES 

84/1 

ATANG,  C.I. 

FIELD  DEPENOENCE/INnEPEHDENCE 

84/1 

ATANG,  C.I. 

TIME  FACTOR 

84/1 

BARON,  L.J. 

TELEVISION 

79/158 

BARON,  L.J. 

CHILDREN 

79/153 

RARON.  L.J. 

EYE  MOVEMENT 

79/158 

BECKER,  A. 

VISUAL  LITERACY 

80/55 

BECKER,  A. 

GESTALT  APPROACH 

80/55 

BECKER,  A.D. 

CRITICAL  DIALOGUE 

82/469 

BECKER,  A.D. 

TELEVISION 

81/23 

BECKER,  A.D. 

VISUALIZATION 

82/469 

BECKHITH,  0. 

RESEARCH 

34/17 

BECKIIITH,  rj. 

LEARNERS 

83/1 

BECKIIITH,  D. 

LEARNER  CHARACTERISTICS 

34/17 

BECKHITH,  D. 

INSTRUCTIONAL  DEVELOPMENT 

83/1 

BEONAR,  A.K. 

COGNITIVE  STYLE 

79/303 

BEDHAR,  A.K. 

COGNITIVE  APTITUDE 

79/303 

BEOHAR,  A.K. 

ACADEMIC  SUCCESS 

79/303 

BERBEKAR,  R. 

BRAIN  RESEARCH 

33/736 

BERBEKAR,  R. 

INSTRUCTIONAL  DESIGN 

33/735 

BERRY,  L.H. 

COGNITIVE  STYLE 

84/34 

BERRY,  L.H. 

RESEARCH 

82/483 

BERRY,  L.H. 

RATE-MODIFIED  SPEECH 

32/483 

BERRY,  L.il. 

AUDITORY  LEARNING 

83/51? 

BERRY,  L.H. 

COGNITIVE  STYLE 

33/517 

BERRY,  L.H. 

VISUALIZATION 

82/21 

BERRY,  L.H. 

PICTORIAL  RESEARCH 

81/31 

BERRY,  L.H. 

COLOR 

32/21 

BERRY,  L.H. 

CULTURAL  VARIATIONS 

83/46 

BERRY,  L.H. 

COLOR 

33/46 

BERRY,  L.H. 

PICTORIAL  RESEARCH 

83/46 

BERRY,  L.H. 

TIME-COMPRESSED  SPEECH 

33/517 

BERRY,  T. 

PERSUASION 

33/33 

BERRY,  T. 

FEAR 

33/53 

BOVY,  R.C. 

COGNITIVE  LEARNING 

81/35 
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YR/PAGE 

BOVY,  R.C. 

INSTRUCTIONAL  DESIGN 

81/35 

BOWIE,  M.M 

DEMOGRAPHIC 

83/74 

BOWIE,  M.I1. 

PERFORMANCE 

83/74 

BOWIE,  M.M. 

MEDIA  SPECIALIST 

83/74 

BRANSON,  R.K. 

INSTRUCTIONAL  DESIGN 

79/602 

BRATTON,  B. 

BEMAVIORAL  OBJECTIVES 

80/190 

BRAVERMAM,  M. 

TELEVISION 

31/78 

BRAVERMAN,  M. 

ATTENTION 

81/78 

BRIDGES,  H. 

PROGRAMMED  INSTRUCTION 

32/154 

BRIDGES,  N. 

AURAL  PERCEPTION 

82/154 

BRIDC^S,  fl. 

MUSIC 

82/154 

BRODY,  P. 

PICTORIAL  RESEARCH 

30/70 

BRODY,  P. 

INSTRUCTIONAL  TEXTS 

80/70 

BRODY,  P.J. 

COMPREHENSION 

79/351 

BRODY,  P.J. 

FUNCTIONS 

33/96 

BRODY,  P.J. 

PICTORIAL  RESEARCH 

84/44 

BRODY,  P.J. 

PICTORIAL  RESEARCH 

83/96 

BRODY,  P.J. 

PICTORIAL  RESEARCH 

79/351 

BRODY,  P.J. 

NATURALISTIC  INQUIRY 

84/44 

BRODY,  P.J. 

INSTRUCTIONAL  METHODS 

84/44 

BROOKE,  M.L. 

SYMBOL  LEARNING 

8/85 

BROOKE,  M.L. 

VISUAL  LEARNING 

81/85 

BRUCE,  K.L. 

COMPUTERS 

84/331 

BRUCE,  K.L. 

INSTRUCTIONAL  MANAGEMENT 

84/331 

BRUCE,  K.L. 

COGNITIVE  STYLE 

84/331 

BURNELL,  S. 

MEDIA  SPECIALIST 

79/191 

BURHELL,  S. 

PRINCIPALS 

79/191 

BURHELL,  S. 

PERCEPTIONS 

79/191 

BURROWAY,  R.L. 

COGNITIVE  STYLE 

84/56 

BURP.OWAY,  R.L. 

COMPUTERS 

84/56 

BURROWAY,  R.L. 

TESTING 

84/56 

BURTON,  J. 

MATCHING  LEARNING  THEORY 

80/630 

BURTOH,  J. 

INSTRUCTIONAL  TECHNOLOGY 

80/630 

BURTON,  J. 

EVALUATION 

30/630 

CANELOS,  J 

RESEARCH 

32/27 

CANE LOS,  J. 

RETENTION 

33/125 

CANELOS,  J. 

FIELD  DEPENDENCE 

81/88 

CANELUS,  J. 

BEHAVIORAL  OBJECTIVES 

30/35 

CANELOS,  J. 

VISUALIZED  INSTRUCTION 

82/183 

CAHELOS,  J. 

INFORMATION  PROCESSING 

81/88 

CANELOS,  J. 

CUEING 

84/72 

CANELOS,  J. 

THEORY 

82/27 

CANELOS,  J. 

MEDIATED  INSTRUCTION 

34/72 

CANELOS,  J. 

NETWORKING 

8]  /38 

CANELOS,  J. 

RESEARCH 

32/153 

CANELOS,  J. 

FIELD  DEPENDENCE/INDEPENDENCE 

80/35 

CANELOS,  J. 

ENCODING 

83/125 

CANELOS,  J. 

LEARNING 

84/72 

CANELOS.  J. 

LEARNING 

82/183 

CANELOS,  J. 

VISUALIZATION 

00/85 

CANELOS,  J. 

DWYER  RESEARCH 

32/27 

CANELOS,  J. 

INFORMATION  CUEIIicj 

83/125 

CAREY,  J.O. 

MEMORY  STRATEGIES 

81/166 

CAREY,  J.O. 

ABSTRACT  LEARNING 

81/105 

CAREY,  J.O. 

CONCRETE  LEARNING 

81/105 

CAREY,  L.n. 

SELF  EVALUATION 

79/212 

CAREY,  L.I1. 

FEEDBACK 

79/212 

CARL,  D.L. 

ADMINISTRATORS 

34/99 

CARL,  D.L. 

COMPUTERS 

04/99 
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DESCRIPTOR 

YR/PAGE 

CARL,  D.L. 

PERCEPTIONS 

84/99 

CARRIER,  C. 

TEACHER  THEORIES 

82/197 

CARRIER,  C. 

TEACHER  PRACTICES 

82/197 

CIIEZIK,  M.A. 

PROSE  MATERIAL 

82/33 

CHEZIK,  H.A. 

LEARNING 

82/33 

CH IS  WELL,  J. 

EMPIRICAL  RESEARCH 

80/98 

CHISWELL,  J. 

IMAGERY 

80/93 

CHUTE,  A. 

TELECONFERENCE 

82/235 

CHUTE,  A.G. 

TELECONFERENCE 

83/283 

CLARK,  F. 

META-ANALYTIC 

80/125 

CLARK,  F. 

PICTORIAL  RESEARCH 

30/125 

CLARK,  F.E. 

RESEARCH 

79/1 

CLARK,  F.E. 

RESEARCH 

82/144 

COLE,  D.D. 

COMPUTERS 

83/295 

COOK,  S. 

INSTRUCTIONAL  MEDIA 

82/439 

COOK,  S. 

FIELD  DEPENDENCE 

82/439 

COOK,  S. 

ATTITUDES 

82/439 

CROSS MAN,  J. 

NONVERBAL  COMMUNICATION 

83/776 

CROSS HAN,  J. 

AMERICANESE 

83/776 

DAVIDSON,  G.V. 

FIELD  DEPENDENCE/INDEPENDENCE 

83/156 

DAVIDSON,  G.V. 

DENTAL  HYGIENE 

83/156 

DE  MELO,  H. 

INSTRUCTIOHAL  VARIABLES 

83/175 

OE  MELO,  H. 

INSTRUCTIONAL  EFFECT 

83/203 

OE  MELO,  H. 

VISUAL  TESTING 

83/175 

DE  HELO,  H. 

INTERACTIONS 

83/175 

DE  MELO,  H. 

VISUALIZED  INSTRUCTION 

83/203 

DE  MELO,  H.T. 

INSTRUCTIONAL  EFFECT 

82/40 

DEMELO,  H.T. 

TESTING 

82/40 

DEMELO,  H.T. 

ENCODING 

81/120 

DEMELO,  H.T. 

VISUAL  TESTING 

81/120 

DII10ND,  P. 

RESEARCH 

84/118 

DIMOND,  P. 

'  PUBLICATIONS 

84/118 

DIOUNE,  J. P. 

PSYCHOEPISTEMOLOGY 

81/486 

DIOMNE,  J. P. 

HEHISPHERICITY 

81/486 

DODGE,  B. 

INSTRUCTIONAL  DESIGN 

80/166 

DODGE,  B. 

LEARNER  INTEREST 

80/166 

DRESANG,  E.T. 

MAINSTREAMING 

82/255 

DRESANG,  E.T. 

MEDIA  UTILIZATION 

82/256 

DRESANG,  E.T. 

ATTITUDES 

82/256 

nUCHASTEL,  P. 

ILLUSTRATIONS 

81/137 

DUNN,  W. 

3EHAVI0RAL  OBJECTIVES 

80/190 

DWYER.  F. 

CUEING 

84/72 

DWYER,  F. 

MEDIATED  INSTRUCTION 

84/72 

DWYER,  F. 

LEARNING 

84/72 

DWYER,  F.M. 

VISUAL  CUEING 

82/54 

DWYER,  F.h. 

TESTING 

82/40 

DWYER,  F.M. 

INTERACTIONS 

83/175 

DWYER.  F.fl. 

BEHAVIORAL  OBJECTIVES 

82/54 

DWYER,  F.M. 

ENCODING 

81/120 

DWYER,  F.M. 

VISUALIZATION 

82/60 

DWYER,  F.M. 

INSTRUCTIONAL  EFFECT 

82/60 

DWYER,  F.M. 

INSTRUCTIONAL  EFFECT 

82/40 

DWYER,  F.M. 

INSTRUCTIONAL  VARIABLES 

83/175 

DWYER,  F.H. 

LEARNING 

82/33 

DWYER,  F.M. 

RETRIEVAL  STRATfGIES 

82/59 

DWYER.  F.M. 

ACHIEVEtlENT 

82/54 

DWYER,  F.M. 

BEHAVIORAL  OBJECTIVES 

82/15 

DWYER,  F.H. 

SYSTEMATIC  EVALUATION 

32/2 

DWYER,  F.H. 

COGNITIVE  LEARNING 

82/69 
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DWYER,  F.M. 

INSTRUCTIONAL  EFFECT 

82/15 

DWYER,  F.M. 

VISUALIZED  INSTRUCTION 

33/203 

DWYER,  F.M. 

PROSE  MATERIAL 

82/33 

DWYER,  F.M. 

VISUAL  TESTING 

83/175 

DWYER,  F.M. 

INSTRUCTIONAL  EFFECT 

83/203 

DWYER,  F.M. 

VISUAL  TESTING 

81/120 

DVfYER,  F.M. 

STIMULUS-EXPLICITHESS 

82/15 

DWYER,  F.M. 

RESEARCH 

79/20 

EHRLICH,  L.R. 

COMPUTER  SIMULATION 

79/631 

EL-GAZZAR,  A.I. 

COLOR 

84/127 

EL-GAZZAR,  A.I. 

MEMORY 

84/127 

EL-GAZZAR,  A.I. 

PICTORIAL  RESEARCH 

84/127 

ERNEST,  P.S. 

EDUCATIONAL  TECHNOLOGY 

82/27R 

ERNEST,  P.S. 

TEACHER  COMPETENCE 

82/278 

ERNEST,  P.S. 

ASSESSMENT 

82/278 

ESQUE,  T. 

INDUSTRY 

84/394 

ESQUE,  T. 

TASK  ANALYSIS 

83/394 

FILAN,  G.L. 

RESEARCH 

79/28 

FkAN,  G,L. 

BEHAVIORAL  OBJECTIVES 

79/28 

FILAN,  G.L. 

THEORY 

79/28 

FLEMING,  M. 

LEARNER  CHARACTERISTICS 

80/201 

FLEMING,  M. 

DESIGN 

84/163 

FLEMING,  M. 

MEDIA  TECHNIQUES 

80/201 

FLEMING,  M. 

LEARNERS 

84/163 

FLEMING,  M. 

VISUALIZATION 

84/163 

FLEMING,  M. 

INSTRUCTIONAL  MEDIA 

80  /  201 

FLEMING,  M.L. 

BEHAVIORAL  SCIENCE 

79/73 

FLEMING,  M.L. 

RESEARCH 

79/73 

FRENCH,  M. 

VISUALIZATION 

83/263 

FRENCH,  M. 

MEDIA  TECHNIQUES 

84/178 

FRENCH,  M. 

APTITUDE 

83/226 

FRENCH,  M. 

INSTRUCTION 

84/178 

FRENCH,  M. 

APTITUDE 

84/178 

FRENCH,  M. 

VISUAL  LEARNING 

83/226 

FRENCH,  M. 

SUPPLAHTATION  APPROACH 

83/263 

GENTRY,  C. 

EVALUATION 

81/147 

GENTRY,  C. 

INSTRUCTIONAL  DESIGN 

81/147 

GERLACH,  V. 

ALGORITHMIC  INSTRUCTION 

80/217 

GERLACH,  V. 

ALGORITHMIC  INSTRUCTION 

80/440 

GERLACH,  V. 

PERCEPTUAL-MOTOR 

80/217 

GERLACH,  y.S. 

BEHAVIORAL  OBJECTIVES 

79/241 

GERLACH,  V.S. 

BEHAVIORAL  OBJECTIVES 

79/28 

GERLACH,  V.S. 

RESEARCH 

79/23 

GERLACH,  V.S. 

THEORY 

79/28 

GILBERT,  R.M. 

MEDIA  UTILIZATION 

82/311 

GILBERT,  R.M. 

TEACHING 

82/311 

GLEASON,  J.J. 

ETHNOGRAPHY 

81/670 

GOLDSTEIN,  M. 

SPECIAL  EDUCATION 

82/105 

GOLDSTEIN,  M. 

INSTRUCTIONAL  SYSTEMS 

82/105 

GOLDSTEIN,  H. 

EVALUATION 

82/105 

GRABOWSKI,  B. 

INSTRUCTIONAL  DESIGN 

82/46 

GRAB0V6KI,  B. 

INTEGRATED  LEARNING  SYSTEM 

82/46 

GRABOl^KI,  B. 

PRFSERVICE  TEACHERS 

30/220 

GRABOlfSKI,  B. 

ATTITUDES 

80/220 

GRABOIKKI,  B. 

PERSUASION 

80/220 

GRAY,  J. 

MEDIA  PROGRAM 

82/360 

GRAY,  J. 

ATTITUDES 

82/360 

GUZflAN-MALDONADO,  A. A. 

ETHNOGRAPHY 

81/670 

HAAS,  N. 

COMPUTER-ASSISTED  INSTRUCTION 

84/402 
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HAAS,  N. 

MOTIVATION 

84/402 

HANCOCK,  B.W. 

TELECONFERENCE 

93/283 

HANCOCK,  B.W. 

TELECONFERENCE 

82/235 

HANNAFIM,  M. 

FEEDBACK 

80/244 

HANNAFIN,  M. 

MATHEMATICS 

80/244 

HANNAFIH,  M.J. 

CHILDREN 

82/338 

HANNAFIN,  fl.J. 

PICTORIAL  RESEARCH 

84/220 

HANNAFIN,  H.J. 

COMPUTERS 

83/295 

HANNAFIN,  H.J. 

AURAL  INSTRUCTION 

83/533 

HANNAFIN,  fl.J. 

LEARNING  STRATEGIES 

82/325 

HANNAFIN,  M.J. 

PROSE 

84/220 

HANNAFIN,  H.J. 

MEMORY  STRATEGIES 

81/166 

HANNAFIN,  M.J. 

VIDEOTAPED  INSTRUCTION 

83/533 

HANNAFIN,  H.J. 

ANALYSIS 

82/325 

HANNAFIN,  H.J. 

RETENTION 

83/533 

HANNIFAN,  H.J. 

LEARNING  STRATEGICS 

82/338 

HAHHIFIH,  H.J. 

CONCRETE  LEARNING 

81/105 

HANNIFIN,  H.J. 

ABSTRACT  LEARNING 

81/105 

HARRISON,  R. 

BILINGUAL  EDUCATION 

80/262 

HARRISON,  R. 

VISUAL  PERCEPTION 

80/262 

HARRISON,  R.T. 

NONVERBAL  COMMUNICATION 

83/776 

HARRISON,  R.T. 

AHERICANESE 

83/776 

HEDBERG,  J.G. 

CROSS  CULTURAL  ANALYSIS 

79/244 

HEDBERG,  J.G. 

HIGHER  EDUCATION 

79/244 

HEOBERG,  J.G. 

INSTRUCTIONAL  INNOVATION 

79/244 

HENNIGAN,  T.L. 

TEACHING 

32/311 

HENNIGAH,  T.L. 

MEDIA  UTILIZATION 

82/311 

HINES,  S.J. 

VISUALIZATION 

82/352 

HINES,  S.J. 

BRAIN  WAVES 

82/352 

HODGES,  Y.A. 

ATTITUDES 

82/360 

HODGES,  Y.A. 

MEDIA  PROGRAM 

82/360 

HOE LS CHER,  S. 

COMPUTERS 

84/99 

HOELSCHER,  S. 

PERCEPTIONS 

84/99 

HOELSCHER,  S. 

ADMINISTRATORS 

84/99 

HOLLIDAY,  W.G. 

DIAGRAMS 

81/715 

HOLLIDAY,  U.W. 

LEARNING 

31/715 

HORTIN,  J. A. 

PROBLEM  SOLVING 

84/240 

HORTIM,  J. A. 

VISUALIZATION 

82/376 

HORTIN,  J. A. 

THEORY 

82/376 

HORTIN,  J. A. 

IMAGERY 

84/240 

HORTON,  J. A. 

VISUALIZATION 

83/318 

HORTOtJ,  J. A. 

RESEARCH 

79/140 

HORTON,  J. A. 

EDUCATIONAL  TECHNOLOGY 

83/318 

HORTON,  J. A. 

AV  COMMUNICATION  REVIEW 

79/140 

HUGHS,  L.H. 

COMPREHENSION 

84/499 

HUGHS,  L.H. 

PICTORIAL  RESEARCH 

84/499 

HUGHS,  L.H. 

TIME-COMPRESSED  SPEECH 

84/499 

ISRAELITE,  L. 

SELF  EVALUATION 

79/212 

ISRAELITE,  L. 

FEEDBACK 

79/212 

JACKSON,  A. 

BRAIN  RESEARCH 

83/736 

JACKSON,  A. 

INSTRUCTIONAL  DESIGN 

83/736 

JACOBS,  R.L. 

INTERACTIONS 

82/396 

JACOBS,  R.L. 

PS  I 

82/396 

JACOBS,  R.L. 

COGNITIVE  STYLE 

82/396 

JENIIINGS,  T. 

ACHIEVEMENT 

82/54 

JENNINGS,  T. 

ACHIEVtMENT 

00/280 

JENNINGS,  T. 

VISUAL  CUEING 

80/280 

JENNINGS,  T. 

VISUAL  CUEING 

82/54 

JENNINGS,  T. 

BEHAVIORAL  OBJECTIVES 

82/54 
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JENNINGS.  T. 

INSTRUCTION 

80/280 

JOHNSOfl,  K.A. 

1  V 

82/404 

JONASSEN,  D.H. 

PERFORMANCE 

80/293 

JONASSEN.  D.H. 

PROGRAMMED  INSTRUCTION 

79/3364 

JONASSEH,  D.H. 

MEMORY  STRATEGIES 

79/364 

JONASSEII,  D.H. 

TEACHING 

81/233 

JONASSEN,  D.H. 

COGNITIVE  STYLE 

80/P93 

JONASSEN,  D.H. 

CONTENT  TREATflEN."  INTERACTION 

81/185 

JONASSEN,  D.H. 

COGNITIVE  STYLE 

31/233 

JONASSEN.  D.H. 

COGNITIVE  STYLE 

8''/329 

JORGENSEN,  S. 

TEACHING 

31/260 

JORGENSEK,  S. 

TECHNOLOGt 

81/260 

JOSEPH,  J. 

SUBJECT  KNOWLEDGE 

30/311 

JObtPH,  J. 

VISUALIZATION 

80/311 

JOSEPH,  J. 

ILLUSfRATIONS 

80/311 

JOSEPH,  J.H. 

INSTRUCTIONAL  EFFECT 

82/60 

JOSEPH,  J.H. 

ACHIEVEMENT 

83/357 

JOS£PH,  J.H. 

INSTRUCTIONAL  EFFECT 

79/380 

JOSEPH,  J.H. 

VISUALIZATION 

83/357 

JOSEPH,  J.H. 

PRESENTATION  MODE 

83/357 

JOSEPH,  J.H. 

VISUALIZATION 

82/60 

JOSEPH,  J.H. 

VISUALIZATION 

79/3""' 

JOSEPH,  M.R. 

INSTRUCTIONAL  STRATEGIES 

83/370 

JOSEPH,  M.R. 

^lELD  INDEPENDENCE 

83/370 

JOSEPH,  M.R. 

COORDINATE  CONCEPTS 

83/370 

KELLER,  P.F.G. 

ITV 

s?./m 

KENNEDY,  P, 

TASK  ANALYSIS 

83/394 

KENNEDY,  P. 

INDUSTRY 

83/394 

KERR,  S.T. 

INSTRUCTIONAL  DESIGN 

409 

KERVIH,  D. 

MEDIA  TECHNIQUES 

84/253 

KERVIN,  D, 

STRUCTURE 

84/253 

KING,  F.J. 

COMPUTER-BASED  INSTRUCTION 

34/260 

KING,  F.J. 

RESEARCH 

84/^60 

KLOOCK,  T.R. 

INSTRUCTIONAL  MEDIA 

82/439 

KLOOCK,  T.R. 

FIELD  DEPENDENCE 

82/439 

KLOOCK,  T.R. 

ATTITUDES 

82/439 

KOETTING,  J.R, 

PHILOSOPHICAL  FOUNDATIONS 

34/290 

KOETTING,  J.R, 

INSTRUCTIONAL  TECHNOLOGY 

83/416 

KOETTING,  J.R. 

TECHNOLOGY 

31/289 

KOETTING,  J.R. 

PH"  OSOPHICAL  FOUNDATIONS 

83/416 

KOETTING,  J„R. 

PHILOSOPHICAL  FOUNDATIONS 

84/307 

KOETTING,  J.R. 

INSTRUCTIONAL  DESIGN 

34/307 

KOETTING,  J.R. 

THEORY 

81/239 

KOETTING,  J.R. 

THLORY 

84/290 

KOETTING,  J.R.. 

CURRICULUM  THEORY 

34/307 

KOETTING,  J.R. 

NATURALISTIC  INQUIRY 

84/290 

KORZENNY,  S.S. 

REINFORCEMENT 

31/345 

KORZENNY,  S.S. 

TELEVISION 

81/345 

KREY,  C.L. 

FIELD  DEPENDENCE/INDEPENDENCE 

83/441 

KREY,  C.L. 

DEMOGRAPHIC 

83/441 

Kii^.riss,  J. 

UNIVERSITY  INSTRUCTION 

30/327 

KJRFISS,  R. 

CONCRETE  LEARNER 

80/327 

LA  fROIX,  P. 

COORDINaT:  CONCEPTS 

83/370 

LA  L'^TX,  P. 

FIELD  INDEPENDENCE 

83/370 

LA  C  ..iX,  P. 

INSTRUCTIONAL  STRATEGICS 

83/370 

LAMBERSKI,  R. 

BILINGUAL  LEARNERS 

80/1 

LAMDERSKI,  R. 

COGNlriV:  Z^FZCT 

80/1 

LAMBERSKI,  R. 

COLOR 

30/337 

LAMBERSKI,  R. 

IMAGERY 

30/93 
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LAMBER3KI,  R. 

EMPIRICAL  RESEARCH 

80/98 

LAMBERSKI ,  R. 

PICTORIAL  ELABORATION 

80/1 

LAMBERSKI,  R.J. 

COLOR 

79/417 

LAMBERSKI,  R.J. 

COLOR 

02/64 

LAMBERSKI ,  R.J. 

BLACK/WHITE  LEARNING 

79/417 

LAMBERSKI,  R.J. 

INSTr.UCTIONAL  EFFECT 

82/64 

LAMBERSKI,  R.J. 

RETENTION 

82/64 

LAMBERSKI ,  R.J. 

ACHIEVEMENT 

79/417 

LAPIERRE,  R.C. 

TELECONFERENCE 

82/235 

LEGENZA,  A. 

COMPREHEM^^ION 

79/351 

legenz^*,  a. 

PICTORIAL  RESEARCH 

79/351 

LEPS,  A. A. 

COGNITIVE  STYLE 

80/381 

LEPS,  A. A. 

VISUALIZED  INSTRUCTION 

80/381 

LEVIE,  W.H. 

PICTORIAL  RESEARCH 

81/388 

LEVIE,  W.H. 

LEARNER  CHARACTERISTICS 

80/201 

LEVIE,  W.H. 

PICTORIAL  RESEARCH 

81/388 

LEvJt,  W.H. 

INSTRUCTIONAL  MEDIA 

80/201 

LEVIcl,  W.H. 

MEDIA  TECHNIQUES 

80/201 

LEWIS,  R.F. 

TELEVISION 

79/C50 

LEWIS,  R.F. 

EVALUATION 

79/650 

LUKOWSKY,  J. 

TECHNOLOGY  HISTORY 

81/409 

LUKOIVSKY,  J. 

RESEARCH 

81/409 

flAIN,  R. 

LEARNING 

79/267 

flAIN,  R. 

BEHAVIORAL  OBJECTIVES 

79/267 

"1AIM,  R. 

AUDIOVISUAL  PRESENTATION 

79/257 

MAHN,  R.E. 

MUSIC 

79/429 

ft! A  iltl        r\  r 

MANN,  R.E. 

L^STENIHG  COMPREHENSION 

79/429 

HARTIN,  B.L. 

EDUCATION 

83/460 

flARTiN,  B.L. 

PSYCHOLOGICAL  PERSPECTIVE 

83/461 

MARTIN,  N.N. 

INSTRUCTIONAL  DESIGN 

79/321 

flARTIN,  N.N. 

ENVIROflMEHT 
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81/428 
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MORGAN,  R.M. 

EDUCATIONAL  DEVELOPMENT 
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MOSELY.  M.L. 
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CRITICAL  DIALOGUE 
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EDUCAT.ONAL  TECHNOLOGY 
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SHROCK,  J, A 

PROGRAM  EVALUATION 
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FILM 
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FEAR 
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ATTITUDES 

79/''»21 

SIMONSON,  H.R. 
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RFRRY    L  H 

UL.          If     L«  •  11  . 

ft/1  /"^A 

HUGHS    L  H 

flA /AQQ 

LEVIE.  W  H 

L*LaflLaf         11.  11. 

rtl  /"^ftft 

UX  A  <JOO 

CLARK,  F. 

80/125 

MCISAAC,  M.S. 

84/386 

BRODY,  P.J. 

83/96 

BRODY.  P  J 

8d  /4d 

WHITE     P  M 

nil  1  1  L.  ,    t  .  n  . 

70/1 AA 

f    A  IHH 

SAVENYE,  W. 

83/668 

JOSEPH,  J.H. 

83/357 

SHRIGLEY,  R. 

80/220 

WELLIVER,  P. 

80/220 
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PRESERVICE  TEACHERS 

GRABOWSKI.  B. 

80/220 

PRINCIPALS 

BURNELL.  S. 

79/191 

PRIOR  KNOWLEDGE 

RICHARDS.  B. 

84/446 

PROBLEM  SOLVING 

HORTIN,  J. A. 

84/240 

PROGRAM  EVALUATION 

SHROCK,  S.A 

83/682 

PROGRAMMED  INSTRUCTION 

MCGRADY,  D.S. 

84/354 

PROGRAMMED  INSTRUCTION 

JONASSEN,  D.H. 

79/3364 

PROGRAMMED  INSTRUCTION 

BRIDGES.  N. 

82/154 

PROSE 

HANNAFIN,  M.J. 

84/220 

PROSE  LEARNING 

MOSELY,  M.L. 

83/707 

PROSE  LEARNING 

STORY,  N.O, 

83/707 

PROSE  MATERIAL 

DWYER.  F.M. 

82/33 

PROSE  MATERIAL 

CHEZIK,  H.A. 

82/33 

PS  I 

JACOBS,  R.L. 

82/396 

PSYCHOEPISTFMOLOGY 

DIONHE,  J. P. 

81/486 

PSYCHOEPISTEMOLOGY 

RAN COURT,  R. 

81/486 

PSYCHOLOGICAL  PERSPECTIVE 

MARTIN,  B.L. 

83/460 

PUBLICATIONS 

SIHONSON,  M. 

84/118 

PUBLICATIONS 

WINN,  B. 

84/607 

PUBLICATIONS 

DIMOND,  P. 

84/118 

RATE-MODIFIED  SPEECH 

OLSON,  J.S. 

82/483 

RATE-MODIFIED  SPEECH 

BERRY,  L.H. 

82/483 

REINFORCEMENT 

KORZENNY,  S.S- 

81/345 

RELEVANCE 

WH I  TAKER,  J. 

80/569 

RELEVANCE 

SULLILVAN,  H. 

80/569 

RESEARCH 

LUKOWSKY,  J. 

81/409 

RESEARCH 

CLARK,  F.E. 

82/144 

RESEARCH 

ROBERTS,  D.M. 

79/132 

RESEARCH 

Dl^YER,  F.M. 

79/20 

RESEARCH 

TORKELSON,  G.M. 

81/664 

RESEARCH 

REID,  G.A. 

81/509 

RESEARCH 

DIMOND,  P. 

84/118 

RESEARCH 

HORTON,  J. A. 

79/140 

RESEARCH 

ANGERT,  J.F. 

79/1 

RESEARCH 

SHERIFF,  D.E. 

79/140 

RESEARCH 

ANGERT,  J.F. 

82/144 

RESEARCH 

CANELOS,  J. 

8?/27 

RESEARCH 

SIMONS  ON,  M. 

84/118 

RESEARCH 

BERRY,  L.H. 

82/483 

RESEARCH 

RAG AN,  T. 

84/433 

RESEARCH 

CLARK,  F.E. 

79/1 

RESEARCH 

KING,  F.J. 

84/260 

RESEARCH 

FILAN,  G.L. 

79/28 

RESEARCH 

ROBLYER,  M.D. 

84/2'jO 

RESEARCH 

GERLACH,  V.S. 

79/28 

RESEARCH 

WINN,  B. 

84/607 

RESEARCH 

OLSON,  J.S. 

82/483 

RESEARCH 

SMITH,  P.L. 

84/487 

RESEARCH 

WHITE,  D.H. 

79/144 

RESEARCH 

FLEHIHG,  M.L. 

79/73 

RESEARCH 

TORKELSON,  G.M. 

84/534 

RESEARCH 

CANELOS,  J. 

82/163 

RESEARCH 

BECKWITH,  D. 

84/17 

RETEHTIOH 

LAMBERSKI,  R.J. 

82/64 

RETENTION 

HANNAFIN,  M.J. 

83/533 

RETENTION 

PECK,  K.L. 

83/533 

RETENTION 

TAYLOR,  W. 

33/125 

RETENTION 

CANELOS,  J. 

83/125 

RETENTION 

ROBERTS,  D.H. 

82/90 
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RETRIEVAL  STRATEGIES 

MCBRIDE    ^  n 

OC/OJ 

RETRIEVAL  STRATEGIES 

REV  IE  WHIG  MFTHnOS 

NLL J  UN  f   U • 

on  / 000 
80/389 

ROD  AND  FRAMF  TF^T 

J  1 KL 1  DLL  ^    n. J • 

SELF  CONCEPT 

UTI  1  TAM^     n  M 

8Z/0ZI 

SELF  EVALUATION 

T^DATI  TTC  1 
IjKALL 1  I L  »   L • 

79/212 

SELF  EVALUATION 

79/212 

SELF  EVALUATION 

1^1  etc. 

SPECIAL  EDUCATION 

CniAMO  F 

09  /I  nc 
0^/ lUD 

SPECIAL  EDUCATION 

YArnRArri    p  m 

Q9  /I  nc 

Q4/ iUD 

SPECIAL  EDUCATION 

r.n\  nQTFTM  M 

UULUJILiPly  If* 

09  /I  nc 

SPECIAL  EDUCATION 

ALTFR  M 

/I  nc 

STIMULUS -EXPL I CITNESS 

ARNOLD     T  r 

/I  C 

STIHULUS-EXPLICITNESS 

DUYFR     F  M 

Q9  /I  C 

STRUCTURE 

KFRVTN  n 

SUBJECT  KNOWl  FDGF 

UuDLrny  U* 

on  /oil 
0O/3IX 

SUBSUMPTIVE  SFOUFNriNG 

J  1  L  i  N  9  r  • 

on  /c 07 
80/d2/ 

Sl^3SUMPTIVF  ^FnilFWriNf; 

KL  IbLLU 1 n  9  L* 

on  /  c  0  *7 

80/527 

I>b?'^UMPTIVF  ^FnilFWriMf; 

UTTUAM  1 

on  /co^ 
80/52/ 

SUPPLANTATION  AP^^ROACH 

PRFHrM  M 
r  KLii  l^n  9    11 , 

01  /9£') 

^  YflBOL  1  FARMING 

DKUUNL  f    n. L • 

0  /OC 

8/85 

SYSTEMATIC  EVALUATION 

09  /9 

82/2 

TASK  ANALYSIS 

KFNNFDY  P 

0  J/ J57*> 

TASK  ANALYSIS 

UTI  DMAU  T 

on  />!  cn 

TASK  ANALYSIS 

NOVAK  .1 

00  yjoA 

TASK  ANALYSIS 

rcniir  t 

TASK  ANALYSIS 

^HFRMAM  T 

•iJ  1     r\l  mil  f     1  « 

on  /A^n 

TEACHER  COMPETENCE 

Q9  /97Q 

TEACHER  PRACTICES 

MFI  VTN 

Q9 / 1 Q7 

04/ xy/ 

TEACHER  PRACTICES 

fARRIFfc  r 

09  /1 07 

/ Xy/ 

TEACHER  THEORIES 

MFI  VTN  K 

09  /l  07 

TEACHER  THEORIES 

TADRT'^D  r 
U/\KK IS  f   L  » 

09  /I  Q7 

82/19/ 

TEACHERS 

1  iuj\L  i  p  n»L . 

83/502 

TEACHERS 

WAMTrWTT?  T 

09  /7  1  0 

83// X9 

TEACHERS 

83//19 

TEACHERS 

r\uj  LiOlfulUy  Urn 

09/71  Q 

o3// X  9 

TEACHING 

intJA^^TM    n  ij 

UUimijLNj  U.ri, 

01  /9  9  9 

cX/233 

TEACHING 

HFNNTf^AN    T  1 

IfU  nil  &  U /Ml  9      1  cL* 

09/911 
8  4  /  3  X  X 

TEACHING 

r^TI  RFRT     D  M 

09/91  1 
04/3X  X 

TEACHING 

.lORGFNSFN  ^ 

Q1  /9^n 

TECHNOLOGY 

KOFTTTMf^      1  n 

Q  1  /9Q0 

8X /Z89 

TECHNOLOGY 

JUKbLrOLN  p   3  . 

81/260 

TECHNOLOGY  HISTORY 

1  iii^nijci^ .  1 

n  1  /ii  /\n 

81/409 

TELECONFERENCE 

09  /90  9 

8.^/283 

teleconferfntf 

riJMTr  A 

82/235 

TELECONFERENCE 

HAHrnri^    n  u 

n/\i<uuui\  f  D •  fi  • 

09  /9  9  C 

82/235 

TELECONFERENCE 

1  APTFDDF     P  r 
Lnt  ILKKL9  K*U* 

09  /99  C 

TELECONFERENCE 

RAs7Alfni/il^  T      D  D 

Q9  /9Q  9 

83/Zo3 

TELECONFERENCE 

Q  9  /90  9 

o3/Zo3 

TELEVISION 

RRAVFRMAN  M 

8X  / /o 

TELEVISION 

ROBINSON     R  S 

TELEVISION 

RPTKFR     A  n 

OX  f  CO 

TELEVISION 

KORZENNY,  S.S. 

TELEVISION 

BARON.  L  .1 

7Q  /I 
/  !7  /  X  DO 

TELEVISION 

LEWIS     R  F 

7Q  //;cn 

TESTING 

DWYER,  F.H. 

82/40 

TESTING 

MAURER,  M.fl. 

84/318 

TYSON,  L. 

82/519 

TZSTING 

DEMELO,  M.T. 

82/40 
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•NESTING 

RABURN,  J. 

82/519 

TESTiri 

BURRO WAY,  R.L. 

84/56 

TESTING 

SIftONSON,  M.R. 

84/318 

THEORY 

KOETTING,  J.R. 

84/290 

THEORY 

FILAN.  G.L. 

79/28 

THEORY 

GERLACH,  V.S. 

79/28 

THEORY 

HORTIff,  J. A. 

82/376 

THEORY 

WINN,  U. 

80/646 

THEORY 

KOETTING,  J.R. 

81/289 

THEORY 

CANELOS ,  J. 

82/27 

THEORY 

TORKELSON,  G.M. 

84/534 

THEORY 

WILLIAMS,  J. A. 

84/563 

TIME  FACTOR 

ATANG,  C.I. 

84/1 

TIME-COMPRESSED  SPEECH 

BERRY,  L.H. 

83/517 

TIME-COMPRESSED  SPEECH 

OLSON,  J.S. 

83/517 

TIME-COMPRESSED  SPEECH 

HUGHS,  L.H. 

84/499 

TIME-COMPRESSED  SPEECH 

OLSOM,  J.S. 

84/414 

TIME-COMPRESSED  SPEECK 

TANTIBLARPHOL,  S. 

84/499 

TRANSFER  OF  LEmRHING 

RICHARDS,  B. 

84/446 

UNIVERSITY  INSTRUCTION 

KURFISS,  J. 

80/327 

UNIVERSITY  INSTRUCTION 

RUSSELL,  A.L . 

82/548 

VIDEOTAPED  INSTRUCTION 

PECK,  K.L. 

83/533 

VIDEOTAPED  INSTRUCTION 

HANNAFIN,  M.J. 

83/533 

VISUAL  CUEING 

JENNINGS,  T. 

80/230 

VISUAL  CUEING 

DWYER,  F.M. 

82/54 

VISUAL  CUEING 

JENNINGS,  T. 

82/54 

VISUAL  LEARNING 

BROOKE,  M.L. 

81/85 

VISUAL  LEARNING 

WINN.  B. 

82/638 

VISUAL  L^.ARNING 

FRENCH,  M. 

83/226 

VISUAL  LITERACY 

BECKER,  A. 

80/55 

VISUAL  LITERACY 

TURNER,  M.L. 

79/552 

VISUAL  LITERACY 

WINN,  W. 

80/646 

VISUAL  PERCEPTION 

RICKARD,  D. 

80/262 

VISUAL  PERCEPTION 

HAkRISON,  R. 

80/252 

VISUAL  TESTING 

DE  MELO,  H. 

83/175 

VISUAL  TESTING 

DWYER,  F.M. 

81/120 

VISUAL  TESTING 

nWYER,  F.M. 

83/175 

VISUAL  TESTING 

ZABO,  M. 

81/120 

VISUAL  TESTING 

jLMELO,  H.T. 

81/120 

VISUALIZATION 

HORTIN,  J. A. 

82/376 

VISUALIZATION 

JOSEPH,  J.H. 

83/357 

VISUALIZATION 

CANELOS,  J. 

80/85 

VISUALIZATION 

FRENCH,  M. 

83/263 

VISUALIZATION 

DWYER,  F.M. 

82/60 

VISUALIZATION 

MUFFO'.ETTO,  R. 

82/469 

VISUALIZATION 

JOSEPH,  J.H. 

82/60 

VISUALIZATION 

JOSEPH.  J 

80/311 

VISUALIZATION 

BERRY.  L.H. 

82/21 

VISUALIZATION 

BECKER,  A.n. 

82/469 

VISUALIZATION 

HORTON,  J. A. 

83/318 

VISUALIZATION 

HINES ,  S .J. 

82/352 

VISUALIZATION 

JOSEPH,  J.H. 

79/330 

VISUALIZATION 

FLEMING,  M. 

84/153 

VISUALIZATION 

TURNER,  P.M. 

82/581 

VISUALI7ED  INSTRUCTION 

TAYLOR,  W. 

82/183 

VI'^UALizEO  INSTRUCTION 

CANtLOS,  J. 

82/183 

VISUALIZED  INSTRUCTION 

ALTSCHULD,  J. 

82/183 

VISUALIZED  INSTRUCTION 

PARKHURST,  P.E. 

82/31 

VISUALIZED  INSTRUCTION 

DE  MELO,  H. 

83/203 
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VISUALIZED  INSTRUCTION  DWYER,  F.M.  83/203 

VISUALIZED  INSTRUCTION  LEPS,  A. A.  80/381 
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